Mobile device interfaces

ABSTRACT

Electronic devices, interfaces for electronic devices, and techniques for interacting with such interfaces and electronic devices are described. For instance, this disclosure describes an example electronic device that includes sensors, such as multiple front-facing cameras to detect orientation and/or location of the electronic device relative to an object and one or more inertial sensors. Users of the device may perform gestures on the device by moving the device in-air and/or by moving their head, face, or eyes relative to the device. In response to these gestures, the device may perform operations.

RELATED APPLICATIONS

This application claims the benefit of priority to provisional U.S.Patent Application Ser. No. 61/821,658, filed on May 9, 2013 andentitled “Mobile Device User interface”, provisional U.S. PatentApplication Ser. No. 61/821,660, filed on May 9, 2013 and entitled“Mobile Device User interface—Framework”, provisional U.S. PatentApplication Ser. No. 61/821,669, filed on May 9, 2013 and entitled“Mobile Device User interface—Controls”, provisional U.S. PatentApplication Ser. No. 61/821,673, filed on May 9, 2013 and entitled“Mobile Device User interface—Apps”, and provisional U.S. PatentApplication Ser. No. 61/821,664, filed on May 9, 2013 and entitled“Mobile Device User interface—Idioms”, each of which his incorporated byreference in its entirety herein.

BACKGROUND

A large and growing population of users employs various electronicdevices to perform functions, such as placing telephone calls (voiceand/or video), sending and receiving email, text messaging, accessingthe internet, playing games, consuming digital content (e.g., music,movies, images, electronic books, etc.), and so on. Among theseelectronic devices are electronic book (eBook) reader devices, mobiletelephones, desktop computers, portable media players, tablet computers,netbooks, and the like.

Many of these electronic devices include touch screens to allow users tointeract with the electronic devices using touch inputs. While touchinput is an effective way of interfacing with electronic devices in someinstances, in many instances touch inputs are problematic. For example,it may be difficult to use touch inputs when using a device one handed.As another example, when interacting with a device using touch input, auser's finger or stylus typically obscures at least a portion of thescreen.

Additionally, many existing electronic device interfaces are cumbersomeand/or unintuitive to use. For instance, electronic devices commonlydisplay a plurality of available application icons on a screen of theelectronic device. When a large number of applications are installed onthe device, this sort of interface can become cluttered with icons.Moreover, it may be difficult to remember which icon corresponds to eachapplication operation, particularly when application icons change overtime as applications are updated and revised. Additionally, userinterface controls used to perform various functions are often esotericand unintuitive to users, and these also may change over time.

Thus, there remains a need for new interfaces for electronic devices andtechniques for interacting with such interfaces and electronic devices.

BRIEF DESCRIPTION OF THE DRAWINGS

The detailed description is described with reference to the accompanyingfigures. In the figures, the left-most digit(s) of a reference numberidentifies the figure in which the reference number first appears. Theuse of the same reference numbers in different figures indicates similaror identical components or features.

FIG. 1 illustrates an example mobile electronic device that mayimplement the gestures and user interfaces described herein. The devicemay include multiple different sensors, including multiple front-facingcameras, an accelerometer, a gyroscope, and the like.

FIG. 2 illustrates example gestures that a user may perform using thedevice of FIG. 1, with these gestures including a peek gesture, a tiltgesture, a swivel gesture, and a roll gesture.

FIG. 3 illustrates an example where a user performs a peek gesture tothe left, a peek gesture to the right, a tilt gesture to the left, and atilt gesture to the right. As illustrated, each of these gestures causesthe mobile electronic device to perform a different operation.

FIG. 4 illustrates an example where a user performs a swivel gestureand, in response, the device performs a predefined operation.

FIG. 5 illustrates an example of the user interface (UI) of the devicechanging in response to a user selecting a physical home button on thedevice. In this example, the device begins in an application, thennavigates to a carousel of items in response to the user selecting thehome button, and then toggles between the carousel and an applicationgrid in response to the user selecting the home button.

FIGS. 6A-6B illustrate example swipe gestures made from a bezel of thedevice and onto a display of the device.

FIGS. 7A-7H illustrate an array of example touch and multi-touchgestures that a user may perform on the mobile electronic device.

FIG. 8 illustrates an example double-tap gesture that a user may performon a back of the mobile electronic device.

FIG. 9 illustrates an example sequence of UIs that the device mayimplement. The UI of the device may initially comprise a lock screen.Upon a user unlocking the device, the UI may comprise a “home screen”,from which a user may navigate to right or left panels, or to anapplication, from which the user may also navigate to right or leftpanels.

FIG. 10 illustrates an example lock screen and potential right and leftpanels that the device may display in response to predefined gestures(e.g., a tilt gesture to the right and a tilt gesture to the left,respectively).

FIGS. 11A-11E illustrate an example home screen of the device. Here, thehome screen comprises a carousel that a user is able to navigate viaswipe gestures on the display. As illustrated, content associated withan item having focus on the carousel may be display beneath thecarousel.

FIG. 12 illustrates an example where information related to an itemhaving focus in the carousel is initially displayed underneath an iconof the item. In response to a user performing a gesture (e.g., a swipegesture), additional information related to the item may be displayed onthe device.

FIG. 13A illustrates an example home screen (the carousel) of thedevice, as well as example left and right panels. In some instances, thedevice displays the left panel in response to a left tilt gestures andthe right panel in response to a right panel gesture.

FIG. 13B illustrates the example of FIG. 13A with an alternative rightpanel.

FIG. 14 shows an example swiping up gesture made by the user from abottom of the display and, in response, the device displays a grid ofapplications available to the device.

FIG. 15 illustrates an example where the device toggles betweendisplaying a carousel and displaying an application grid in response toa user selecting a physical home button on the device.

FIG. 16 illustrates an example operation that the device may perform inresponse to a peek gesture. Here, the UI of the device initiallydisplays icons corresponding to favorite items of the user and, inresponse to the peek gesture, overlays additional details regarding thefavorite items.

FIG. 17 illustrates an example where a user of the device is able tocause the UI of the device to transition from displaying iconscorresponding to applications stored on the device to iconscorresponding to applications available to the device but storedremotely from the device.

FIG. 18 illustrates example UIs that the device may display when a userlaunches a book application (or “reader application”) on the device. Asillustrated, the center panel may illustrate books available to thedevice and/or books available for acquisition. The left panel,meanwhile, includes settings associated with the book application andmay be displayed in response to a user of the device performing a lefttilt gesture, while the right panel displays icons corresponding tobooks recommended for the user and may be displayed in response to theuser performing a right tilt gesture.

FIG. 19 illustrates an example UI that the device may display. This UIincludes certain information that may be currently pertinent to theuser, such as a current weather near the user, status of any orders ofthe user, and the like.

FIG. 20 illustrates an example settings UI that the device may display.As illustrated, this UI may include icons corresponding to screen shotscaptured on the device.

FIG. 21 illustrates an example scenario where a user requests to launcha search from a settings menu displayed on the device.

FIGS. 22A-22F Illustrate different three-dimensional (3D) badges thatthe device may display atop or adjacent to icons associated with certainitems. These badges may be dynamic and able to change based onparameters, such as how much of the respective item a user has consumed,or the like.

FIG. 23A illustrates an example where a user performs a swivel gesturewhile the device is displaying a UI corresponding to an applicationaccessible to the device. In response to the swivel gesture, the devicemay display a settings menu for operation by a user of the device.

FIG. 23B illustrates an example where a user performs a roll gesturewhile the device is displaying a UI corresponding to an applicationaccessible to the device. In response to the roll gesture, the devicemay display a “quick settings” menu for operation by a user of thedevice.

FIG. 24 illustrates an example where a user performs a swivel gesturewhile the device is displaying a UI corresponding to an applicationaccessible to the device. In response to the swivel gesture, the devicemay display, in part, icons corresponding to application launchcontrols.

FIG. 25 illustrates another example operation that the device mayperform in response to a user performing a swivel gesture. In thisexample, the operation is based in part on a location of the user.Specifically, the device displays information regarding a restaurantthat the user is currently located at and further displays functionalityto allow a user to “check in” at or “like” the restaurant on a socialnetwork.

FIG. 26 illustrates another example geo-based operation that the devicemay perform in response to a user performing a swivel gesture. Here, thedevice displays a map along with traffic information.

FIG. 27 illustrates an example UI of a carousel of icons that isnavigable by a user of the device, with an icon corresponding to a mailapplication having interface focus (e.g., being located at the front ofthe carousel). As illustrated, when an icon has user-interface focus,information associated with an item corresponding to the icon isdisplayed beneath the carousel.

FIG. 28 illustrates an example UI within a mail application. Inaddition, this figure illustrates that the device may display additionalor different information regarding messages in an inbox in response to auser performing a peek gesture on the device.

FIG. 29 illustrates an example inbox UI within a mail application andpotential right and left panels that the device may display in responseto predefined gestures (e.g., a tilt gesture to the right and a tiltgesture to the left, respectively).

FIG. 30 illustrates another example right panel that the device maydisplay in response to a user performing a tilt gesture to the rightwhile viewing an inbox from the mail application.

FIG. 31 illustrates an example UI showing a user composing a new mailmessage, as well as potential right and left panels that the device maydisplay in response to predefined gestures (e.g., a tilt gesture to theright and a tilt gesture to the left, respectively).

FIG. 32 illustrates another example right panel that the device maydisplay in response to the user performing a tilt gesture to the rightwhile composing a new message.

FIG. 33 illustrates an example right panel that the device may displayfrom an open or selected email message received from or sent to aparticular user. In response to the user performing a tilt gesture tothe right, the device may display other messages to and/or from theuser.

FIG. 34 illustrates another example right panel that the device maydisplay from an open email message that the device has received. Inresponse to the user performing a tilt gesture to the right, the devicemay display a UI that allows the user to reply to the sender or to oneor more other parties.

FIG. 35 illustrates an example UI showing a meeting invitation, as wellas potential right and left panels that the device may display inresponse to predefined gestures (e.g., a tilt gesture to the right and atilt gesture to the left, respectively).

FIG. 36 illustrates another example right panel that the device maydisplay in response to a user performing a tilt gesture to the rightwhile the device displays a meeting invitation.

FIG. 37 illustrates an example right panel that the device may displayin response to displaying a tilt gesture to the right while the devicedisplays a calendar.

FIG. 38 illustrates an example UI showing a messaging session betweentwo users, as well as an example right panel that the device may displayin response to a user performing a predefined gesture on the device(e.g., a tilt gesture to the right).

FIG. 39 illustrates an example UI of a carousel of icons that isnavigable by a user of the device, with an icon corresponding to a bookthat the user has partially read currently having user-interface focusin the carousel. As illustrated, the information beneath the carouselcomprises recommended books for the user, based on the bookcorresponding to the illustrated icon.

FIG. 40 illustrates an example UI displaying books accessible to theuser or available for acquisition by the user, as well as an exampleright panel that the device may display in response to a user performinga predefined gesture on the device (e.g., a tilt gesture to the right).

FIG. 41 illustrates an example UI showing books available to the deviceor available for acquisition by the user, as well as example right andleft panels that the device may display in response to a user performinga predefined gesture on the device (e.g., a tilt gesture to the rightand a tilt gesture to the left, respectively).

FIG. 42 illustrates an example UI showing content from within a bookaccessible to the device, as well as example right and left panels thatthe device may display in response to a user performing a predefinedgesture on the device (e.g., a tilt gesture to the right and a tiltgesture to the left, respectively).

FIG. 43 illustrates an example UI of a carousel of icons that isnavigable by a user of the device, with an icon corresponding to a musicapplication currently having user-interface focus in the carousel. Asillustrated, the information beneath the carousel may comprise songs ofa playlist or album accessible to the music application.

FIG. 44 illustrates an example UI showing music albums available to thedevice, as well as additional example information regarding the musicalbums in response to a user performing a predefined gesture (e.g., apeek gesture to the right).

FIG. 45 illustrates an example UI showing music albums available to thedevice, as well as an example right panel showing recommended content inresponse to a user performing a predefined gesture (e.g., a tilt gestureto the right).

FIG. 46 illustrates an example UI showing a particular music albumavailable to the device or currently being played, as well as an exampleright panel showing items that are recommended for the user based on thecurrently displayed album.

FIG. 47 illustrates an example UI showing a particular song playing onthe device, as well as an example right panel showing lyrics or atranscript of the song, if available.

FIG. 48 illustrates an example UI showing music items available foracquisition, as well as example right and left panels that the devicemay display in response to a user performing a predefined gesture on thedevice (e.g., a tilt gesture to the right and a tilt gesture to theleft, respectively).

FIG. 49 illustrates an example UI of a carousel of icons that isnavigable by a user of the device, with an icon corresponding to agallery of photos currently having user-interface focus in the carousel.As illustrated, the information beneath the carousel may comprise photosfrom the gallery. Also shown are example details associated with thephotos that may be displayed in response to a user of the deviceperforming a peek gesture to the right.

FIG. 50 illustrates an example UI showing a particular photo displayedon the device, as well as an example right panel showing informationassociated with the photo.

FIG. 51 illustrates an example UI of a carousel of icons that isnavigable by a user of the device, with an icon corresponding to a musicstore currently having user-interface focus in the carousel. Asillustrated, the information beneath the carousel may compriseadditional music offered for acquisition. Also shown are example detailsassociated with the items that may be displayed in response to a user ofthe device performing a peek gesture to the right.

FIG. 52 illustrates an example UI showing search results associated withitems offered for acquisition, as well as example details associatedwith the items that may be displayed in response to a user of the deviceperforming a peek gesture to the right.

FIG. 53 illustrates an example UI showing a storefront associated withan offering service, as well as example right panel that the device maydisplay in response to a user of the device performing a tilt gesture tothe right.

FIG. 54 illustrates an example UI showing search results associated withitems offered for acquisition, as well as an example right panel thatthe device may display in response to a user of the device performing atilt gesture to the right.

FIG. 55 illustrates an example UI showing a detail page that illustratesinformation associated with a particular item offered for acquisition,as well as an example right panel that the device may display inresponse to a user of the device performing a tilt gesture to the right.

FIG. 56 illustrates an example UI of a carousel of icons that isnavigable by a user of the device, with an icon corresponding to anapplication store currently having user-interface focus in the carousel.As illustrated, the information beneath the carousel may comprise itemsrecommended for the user.

FIG. 57 illustrates an example UI showing search results within anapplication store, as well as an example right panel that the device maydisplay in response to a user performing a tilt gesture to the right.

FIG. 58 illustrates an example UI showing details associated with aparticular application available for acquisition from an applicationstore, as well as an example right panel that the device may display inresponse to a user performing a tilt gesture to the right.

FIG. 59 illustrates an example sequence of Uls and operations foridentifying an item from an image captured by a camera of the device, aswell as adding the item to a list of the user (e.g., a wish list).

FIG. 60 illustrates another example sequence of Uls and operations foradding an item to a wish list of the user using a physical button of thedevice and/or another gesture indicating which of the items the user isselecting.

FIG. 61 illustrates another example sequence of Uls and operations foradding yet another item to a wish list of the user when the user iswithin a browser application.

FIG. 62 illustrates an array of example UIs that the device mayimplement in the context of an application that puts limits on whatcontent children may view from the device and limits on how the childrenmay consume the content.

FIG. 63 illustrates additional UIs that the device may display as partof the application that limits the content and the consumption of thecontent for children using the device.

FIG. 64A illustrates a carousel of items, with a map application havinguser-interface focus.

FIG. 64B illustrates the carousel of items as discussed above, with aparticular item having user interface focus, as well as an example UIthat may be displayed in response to a user selecting the item.

FIG. 65 illustrates an example map and an example right panel that thedevice may display in response to a user of the device performing a tiltgesture to the right.

FIG. 66 illustrates a carousel of items, with a weather applicationhaving user-interface focus.

FIG. 67 illustrates an example UI showing a current weather report for aparticular geographical location, as well as an example right panel thatthe device may display in response to a user performing a tilt gestureto the right.

FIG. 68 illustrates two example UIs showing a carousel of icons, wherean icon corresponding to a clock application currently hasuser-interface focus.

FIG. 69 illustrates an example UI showing a current time and currentweather, as well as additional details displayed in response to a userperforming a peek gesture to the right. This figure also illustrates anexample settings menu that may be displayed in response to the userperforming a tilt gesture to the left.

FIG. 70 illustrates an example UI showing a current time and a nextscheduled alarm, as well as additional details that the device maydisplay in response to the user performing a peek gesture to the right.

FIG. 71 illustrates another example UI showing a current time of anyscheduled alarms, as well as additional details that the device maydisplay in response to the user performing a peek gesture to the right.

FIG. 72 illustrates an example UI showing a carousel of icons, with anicon corresponding to a document or word-processing application havinguser-interface focus. This figure also illustrates an example UI showingadditional details regarding documents accessible to the device inresponse to a user of the device performing a peek gesture.

FIG. 73 illustrates an example UI showing a list of documents availableto the device, as well as an example UI showing additional detailsregarding these documents in response to a user performing a peekgesture.

FIG. 74 illustrates an example UI that a document application maydisplay, as well as example right and left panels that the device maydisplay in response to the user performing a predefined gesture (e.g., atilt gesture to the right and left, respectively).

FIG. 75 illustrates an example UI showing a web-browsing applicationhaving user-interface focus.

FIG. 76A illustrates an example UI showing example search results inresponse to a user performing a web-based search, as well as exampleright and left panels that the device may display in response to theuser performing a predefined gesture (e.g., a tilt gesture to the rightand left, respectively).

FIG. 76B illustrates another example UI showing an example webpage, aswell as example right and left panels that the device may display inresponse to the user performing a predefined gesture (e.g., a tiltgesture to the right and left, respectively).

FIG. 77 illustrates an example UI showing a calculator application, aswell as an example function that the calculator application may displayin response to the user performing a tilt gesture.

FIG. 78 illustrates a flowchart of an example process of presenting oneor more graphical user interfaces (GUIs) comprising a first portionincluding an icon representing an application and a second portion thatincludes icons or information representing one or more content itemsassociated with the application. The figure also shows techniques forallowing users to interact with the GUIs using one or more inputs orgestures (e.g., peek or tilt gestures).

FIG. 79 illustrates a flowchart of an example process of presenting aGUI including a collection of application icons in a carousel which areusable to open respective applications. The GUI also includesinformation of one or more content items associated with an applicationthat is in interface focus (e.g., in the front of the carousel).

FIG. 80 illustrates a flowchart of an example process of detecting andrecognizing a gesture (e.g., a swivel gesture) and performing anoperation such as those shown in FIG. 23A-FIG. 26 responsive to thegesture.

FIG. 81 illustrates a flowchart of another example process ofrecognizing a gesture (e.g., a swivel gesture) and performing anoperation such as those shown in FIG. 23A-FIG. 26 responsive to thegesture.

FIG. 82 illustrates a flowchart of an example process of presenting GUIsresponsive to a relative orientation of a handheld electronic devicerelative to at least a portion of a body of a user.

FIG. 83 illustrates a flowchart of an example process of presenting GUIsresponsive to a change in orientation of a handheld electronic devicerelative to at least a portion of a body of a user.

DETAILED DESCRIPTION

This disclosure describes, in part, new electronic devices, interfacesfor electronic devices, and techniques for interacting with suchinterfaces and electronic devices. For instance, this disclosuredescribes example electronic devices that include multiple front-facingcameras to detect orientation and/or location of the electronic devicerelative to an object (e.g., head, hand, or other body part of a user, astylus, a support surface, or other object). In some examples, at leastsome of the multiple front facing cameras may be located at or nearcorners of the electronic device. Using the front facing cameras aloneor in combination with one or more other sensors, in some examples, theelectronic device allows for simple one-handed or hands-free interactionwith the device. For instance, the device may include one or moreinertial sensors (e.g., gyroscopes or accelerometers), or the like,information from which may be integrated with information from thefront-facing cameras for sensing gestures performed by a user.

In some examples, users may interact with the device without touching adisplay of the device, thereby keeping the display free of obstructionduring use. By way of example and not limitation, users may interactwith the device by rotating the device about one or more axes relativeto the user's head or other object.

In additional or alternative examples, this disclosure describes examplephysical and graphical user interfaces (UIs) that may be used tointeract with an electronic device. For instance, in some examples, thedisclosure describes presenting a first interface responsive todetecting a first condition (e.g., a first orientation of the electronicdevice relative to the user), and presenting a second interfaceresponsive to a second condition (e.g., a second orientation of theelectronic device relative to the user). In one illustrative example,the first interface may comprise a relatively simple or clean interface(e.g., icons or images with limited text or free of text) and the secondinterface may comprise a more detailed or informative interface (e.g.,icons or images with textual names and/or other information). In otherexamples, the first interface may include first content and the secondinterface may include additional or alternative content.

In addition, the techniques described herein allow a user to viewdifferent “panels” of content through different in-air gestures of thedevice. These gestures may take any form and may be detected throughoptical sensors (e.g., front-facing cameras), inertial sensors (e.g.,accelerometers, gyroscopes, etc.), or the like, as discussed in detailbelow.

Content displayed on the device, meanwhile, may reside in three or morepanels, including a center (default) panel, a left panel, and a rightpanel. In some instances, the “home screen” of the device may residewithin a center panel, such that a leftward-directed gesture causes thedevice to display additional content in a left panel and arightward-directed gesture causes the device to display still moreadditional content in a right panel.

In some instances, the content in the center panel of the home screenmay comprise, in part, an interactive collection, list, or “carousel” oficons corresponding to different applications and/or content items(collectively, “items”) that are accessible to the device. For instance,the content may comprise a list that is scrollable horizontally on thedisplay via touch gestures on the display, physical buttons on thedevice, or the like. However the list is actuated, an icon correspondingto a particular item may have user-interface focus at any one time. Thecontent in the center panel may include (e.g., beneath the carousel)content items associated with the particular item whose icon currentlyhas user-interface focus (e.g., is in a front of the carousel). Forinstance, if an icon corresponding to an email application currently hasuser-interface focus, then one or more most-recently received emails maybe displayed in a list beneath the carousel. Alternatively, in someexamples, instead of displaying the most-recently received emails, asummary or excerpts of the most-recently received emails may beprovided.

In addition, a user may navigate to the left panel or right panel fromthe center panel of the home screen via one or more gestures. In oneexample, a user may navigate to the left panel by performing a “tiltgesture” to the left or may navigate to the right panel by performing atilt gesture to the right. In addition, the user may navigate from theleft panel to the center panel via a tilt gesture to the right, and fromthe right panel to the center panel with a tilt gesture to the left.

A tilt gesture may be determined, in some instances, based onorientation information captured by a gyroscope. As described below, atilt gesture may comprise, in part, a rotation about a vertical “y axis”that runs down a middle of the device. More specifically, a tilt gestureto the left may comprise a clockwise rotation (when the device is viewedfrom a top of the device) and then back to or toward the originalorientation. As such, when a user is looking at a display of the device,a tilt gesture to the left may be determined when a user rotates a leftside of the screen away from him or her by some threshold amount (withthe right side of the screen coming closer) and then back towards theinitial orientation, with these motions being performed consecutively orcontiguously. That is, in some examples, the tilt gesture is detectedonly if these motions occur within a certain amount of time of eachother. A tilt gesture to the right may be defined oppositely.

When the user performs a tilt gesture to navigate from the interactivelist in the center panel to the left panel, the left panel may display alist of content-item libraries available to the device. For instance,the left panel may include icons corresponding to different librariesthat are available to the user (e.g., on the device, in a remote or“cloud” storage, or the like), such as an electronic book library, aphoto gallery, an application library, or the like. When the userperforms a tilt gesture to navigate from the interactive list in thecenter panel to the right panel, meanwhile, the right panel may displaya grid or other layout of applications available to the device.

In addition, applications executable on the devices described herein mayutilize the left-center-right panel layout (potentially in addition toadditional left and right panels to create five-panel layouts or thelike). Generally, the center panel may comprise “primary content”associated with an application, such as text of a book when in abook-reading application. The left panel of an application, meanwhile,may generally comprise a settings menu, with some settings being genericto the device and some settings being specific to the application. Theright panel, meanwhile, may generally include content that issupplementary or additional to the primary content of the center panel,such as other items that are similar to a content item currentlydisplayed on the center panel, items that may be of interest to a userof the device, items available for acquisition, or the like.

In addition to performing tilt gestures to navigate between panels, insome instances the device may be configured to detect a “peek gesture,”as determined by information captured by the front-facing cameras. Whena user performs a peek gesture, the device may, generally, displayadditional or supplemental information regarding whatever content iscurrently being displayed on the device. For instance, if the devicecurrently displays a list of icons corresponding to respective booksavailable for purchase, then a peek gesture to the right (or left) maycause the device to determine and display corresponding prices orratings for the books atop or adjacent to the icons. As such, the useris able to quickly learn more about the items on the display byperforming a quick peek gesture.

As mentioned above, the peek gesture may be determined from informationcaptured by the front-facing cameras. More specifically, the device mayidentify, from the cameras, when the head or face of the user movesrelative to the device (or vice versa) and, in response, may designatethe gesture as a peek gesture. Therefore, a user may effectuate a peekgesture by either moving or turning his or her head to the left and/orby slightly moving the device in the rotation described above withreference to the user.

In addition, the devices described herein may be configured to detect a“swivel gesture” or a gesture made about a “z-axis,” which isperpendicular to the y-axis about which the tilt is detected (the planeof the device). In some instances, a swivel gesture made from the homescreen or from within any application presents a predefined set oficons, such as an icon to navigate to the home screen, navigatebackwards to a previous location/application, or the like. Again, thedevice may detect the swivel gesture in response to orientationinformation captured by the gyroscope, potentially along with otherinformation captured by other sensors (e.g., front-facing cameras,accelerometer, etc.).

In additional or alternative examples, this disclosure describesgraphical UIs that are or give the impression of being at leastpartially three dimensional (3D) and which change or update when viewedfrom different orientations or locations relative to the electronicdevice. For instance, icons representative of applications or contentitems (e.g., electronic books, documents, videos, songs, etc.) maycomprise three-dimensionally modeled objects such that viewing a displayof the electronic device from different orientations causes the displayto update which aspects of the icons the display presents (and, hence,which aspects are viewable to the user). As such, a user of theelectronic device is able to move his or her head relative to the device(and/or vice versa) in order to view different “sides” of the 3D-modeledobjects.

In these instances, user interfaces that are based at least in part on auser's position with respect to a device and/or motion/orientation ofthe device are provided. One or more user interface (UI) elements may bepresented on a two-dimensional (2D) display screen, or other suchdisplay element. One or more processes can be used to determine arelative position, direction, and/or viewing angle of the user. Forexample, head or face tracking (or tracking of a facial feature, such asa user's eyebrows, eyes, nose, mouth, etc.) and/or related information(e.g., motion and/or orientation of the device) can be utilized todetermine the relative position of the user, and information about therelative position can be used to render one or more of the UI elementsto correspond to the user's relative position. Such a rendering can givethe impression that the UI elements are associated with variousthree-dimensional (3D) depths. Three-dimensional depth information canbe used to render 2D or 3D objects such that the objects appear to movewith respect to each other as if those objects were fixed in space,giving the user an impression that the objects are arranged inthree-dimensional space. Three-dimensional depth can be contrasted toconventional systems that simulate 2D depth, such as by stacking orcascading 2D UI elements on top of one another or using a tab interfaceto switch between UI elements. Such approaches may not be capable ofconveying as much information as a user interface capable of simulating3D depth and/or may not provide as immersive an experience as a UI thatsimulates 3D depth.

Various embodiments enable UI elements to be displayed so as to appearto a user as if the UI elements correspond to 3D depth when the user'sposition changes, the device is moved, and/or the device's orientationis changed. The UI elements can include images, text, and interactivecomponents such as buttons, scrollbars, and/or date selectors, amongothers. When it is determined that a user has moved with respect to thedevice, one or more UI elements can each be redrawn to provide animpression that the UI element is associated with 3D depth. Simulationof 3D depth can be further enhanced by integrating one or more virtuallight sources for simulating shadow effects to cause one or more UIelements at depths closer to the user to cast shadows on one or more UIelements (or other graphical elements or content) at depths further awayfrom the user. Various aspects of the shadows can be determined based atleast in part on properties of the virtual light source(s), such as thecolor, intensity, direction of the light source and/or whether the lightsource is a directional light, point light, or spotlight. Further,shadows can also depend on the dimensions of various UI elements, suchas the x-, y-, and z-coordinates of at least one vertex of the UIelement, such as the top left corner of the UI element; the width andheight of a planar UI element; the width, height, and depth for arectangular cuboid UI element; or multiple vertices of a complex 3D UIelement. When UI elements are rendered based on changes to the user'sviewing angle with respect to the device, the shadows of UI elements canbe recast based on the properties of the virtual light source(s) and therendering of the UI elements at the user's new viewing angle.

In some embodiments, the 3D depths of one or more UI elements can bedynamically changed based on user interaction or other input received bya device. For example, an email application, instant messenger, shortmessage service (SMS) text messenger, notification system, visual voicemail application, or the like may allow a user to sort messagesaccording to criteria such as date and time of receipt of a message,sender, subject matter, priority, size of message, whether there areenclosures, among other options. To simultaneously present messagessorted according to at least two dimensions, the messages may bepresented in conventional list order according to a first dimension andby 3D depth order according to a second dimension. Thus, when a userelects to sort messages by a new second dimension, the 3D depths ofmessages can change. As another example, in a multi-tasking environment,users may cause the 3D depths of running applications to be alteredbased on changing focus between the applications. The user may operate afirst application which may initially have focus and be presented at thedepth closest to the user. The user may switch operation to a secondapplication which may position the second application at the depthclosest to the user and lower the first application below the depthclosest to the user. In both of these examples, there may also be otherUI elements being presented on the display screen and some of theseother UI elements may be associated with depths that need to be updated.That is, when the 3D depth of a UI element changes, the UI element maycease to cast shadows on certain UI elements and/or cast new shadows onother UI elements. In still other embodiments, UI elements may beredrawn or rendered based on a change of the relative position of theuser such that shadows cast by the redrawn UI elements must also beupdated. In various embodiments, a UI framework can be enhanced tomanage 3D depth of UI elements, including whether a UI element casts ashadow and/or whether shadows are cast on the UI element and theposition, dimensions, color, intensity, blur amount, transparency level,among other parameters of the shadows.

In addition, or alternatively, a device can include one or more motionand/or orientation determination components, such as an accelerometer,gyroscope, magnetometer, inertial sensor, or a combination thereof, thatcan be used to determine the position and/or orientation of the device.In some embodiments, the device can be configured to monitor for achange in position and/or orientation of the device using the motionand/or orientation determination components. Upon detecting a change inposition and/orientation of the device exceeding a specified threshold,the UI elements presented on the device can be redrawn or rendered tocorrespond to the new position and/or orientation of the device tosimulate 3D depth. In other embodiments, input data captured by themotion and/or orientation determination components can be analyzed incombination with images captured by one or more cameras of the device todetermine the user's position with respect to the device or relatedinformation, such as the user's viewing angle with respect to thedevice. Such an approach may be more efficient and/or accurate thanusing methods based on either image analysis or motion/orientationsensors alone.

These and numerous other aspects of the disclosure are described belowwith reference to the drawings. The electronic devices, interfaces forelectronic devices, and techniques for interacting with such interfacesand electronic devices as described herein may be implemented in avariety of ways and by a variety of electronic devices. Furthermore, itis noted that while certain gestures are associated with certainoperations, these are merely illustrative and any other gestures may beused for any other operation. Further, while example “left”, “right” and“center” panels are described, it is to be appreciated that the contenton these panels are merely illustrative and that the content shown inthese panels may be rearranged in some implementations.

FIG. 1 illustrates an example handheld or mobile electronic device 100that may implement the gestures and user interfaces described herein. Asillustrated, the device 100 includes a display 102 for presentingapplications and content items, along with other output devices such asone or more speakers, a haptics device, and the like. The device 100 mayinclude multiple different sensors, including multiple front-facing,corner-located cameras 104(1), 104(2), 104(3), and 104(4), and 104(5)which, in some instances may reside on the font face of the device 100and near the corners of the device 100 as defined by a housing of thedevice. While FIG. 1 illustrates four corner cameras 104(1)-(4), inother instances the device 100 may implement any other number ofcameras, such as two corner cameras, one centered camera on top and twocameras on the bottom, two cameras on the bottom, or the like.

In addition to the cameras 104(1)-(4), the device 100 may include asingle front-facing camera 106, which may be used for capturing imagesand/or video. The device 100 may also include an array of other sensors,such as one or more accelerometers 108, one or more gyroscopes 110, oneor more infrared cameras 112(1), 112(2), 112(3), 112(4), and 112(5), atouch sensor 114, a rear-facing camera, and the like. In some instances,the touch sensor 114 is integrated with the display 102 to form atouch-sensitive display, while in other instances the touch sensor 114is located apart from the display 102. As described in detail below, thecollection of sensors may be used individually or in combination withone another for detecting in-air gestures made by a user holding thedevice 100.

FIG. 1 further illustrates that the device 100 may include physicalbuttons 116(1) and 116(2), potentially along with multiple otherphysical hardware buttons (e.g., a power button, volume controls, etc.).The physical button 116(1) may be selectable to cause the device to turnon the display 102, to transition from an application to a home screenof the device, and the like, as discussed in detail below. The physicalbutton 116(2), meanwhile, may be selectable to capture images and/oraudio for object recognition, as described in further detail below.

The device 100 may also include one or more processors 118 and memory120. Individual ones of the processors 116 may be implemented ashardware processing units (e.g., a microprocessor chip) and/or softwareprocessing units (e.g., a virtual machine). The memory 120, meanwhile,may be implemented in hardware or firmware, and may include, but is notlimited to, RAM, ROM, EEPROM, flash memory or other memory technology,CD-ROM, digital versatile disks (DVD) or other optical storage, magneticcassettes, magnetic tape, magnetic disk storage or other magneticstorage devices, or any other tangible medium which can be used to storeinformation and which can be accessed by a processor. The memory 120encompasses non-transitory computer-readable media. Non-transitorycomputer-readable media includes all types of computer-readable mediaother than transitory signals.

As illustrated, the memory 120 may store one or more applications 122for execution on the device 100, one or more content items 124 forpresentation on the display 102 or output on the speakers, asensor-fusion module 126, a user-interface module 128, and an operatingsystem 130. The sensor-fusion module 124 may function to receiveinformation captured from the different sensors of the device, integratethis information, and use the integrated information to identify inputsprovided by a user of the device. For instance, the sensor-fusion module126 may integrate information provided by the gyroscope 110 and thecorner cameras 104(1)-(4) to determine when a user of the device 100performs a “peek gesture.”

The user-interface module 128, meanwhile, may present user interfaces(UIs) on the display 102 according to inputs received from the user. Forinstance, the user-interface module 128 may present any of the screendescribed and illustrated below in response to the user performinggestures on the device, such as in-air gestures, touch gestures receivedvia the touch sensor 114, or the like. The operating system module 130,meanwhile, functions to manage interactions between and requests fromdifferent components of the device 100.

FIG. 2 illustrates example gestures that a user may perform using thedevice 100. As illustrated, FIG. 2 defines an x-axis 202, a y-axis 204,and a z-axis 206. The x-axis is within a plane defined by the majorplane of the device 100 and runs along the length of the device 100 andin the middle of the device. The y-axis 204, meanwhile, is also in theplane but runs along the height of the device 100 and in the middle ofthe device. Finally, the z-axis 206 runs perpendicular to the majorplane of the device (and perpendicular to the display of the device) andthrough a middle of the device 100.

As illustrated, a user may perform a peek gesture 208 and a tilt gesture210 by rotating the device 100 about the y-axis 202. In some instances,a peek gesture 208 is determined by the user-interface module when theposition of the user changes relative to the device, as determined frominformation captured by the corner cameras 104(1)-(4). Therefore, a usermay perform a peek gesture 208 by rotating the device slightly about they-axis (thereby changing the relative position of the user's face to thedevice from the perspective of the cameras 104(1)-(4)) and/or by movingthe user's face to the right or left when looking at the display 102 ofthe device 100 (again, changing the user's position relative to thecameras 104(1)-(4)). In some instances, the peek gesture 208 is definedwith reference solely from information from the cameras 104(1)-(4),while in other instances other information may be utilized (e.g.,information from the gyroscope, etc.). Furthermore, in some instances apeek gesture 208 requires that a user's position relative to the device100 change by at least a threshold angle, θ₁.

Next, a user may perform a tilt gesture 210 by rotating the device 100about the y-axis 202 by a threshold amount, θ₂, and then rotating thedevice 100 back the opposite direction by a second threshold amount. Insome instances, θ₂ is greater than θ₁, although in other instances theopposite is true or the angles are substantially equal. For instance, inone example θ₁ may be between about 0.1° and about 5°, while θ₂ may bebetween about 5° and about 30°.

In some implementations, the user-interface module 128 detects a tiltgesture based on data from the gyroscope indicating that the user hasrotated the device 100 about the y-axis in a first direction and hasstarted rotating the device 100 back in a second, opposite direction(i.e., back towards the initial position). In some instances, theuser-interface module 128 detects the tilt gesture 210 based on therotation forwards and backwards, as well as based on one of the camerason the front of the device 100 recognizing the presence of a face orhead of a user, thus better ensuring that the a user is in fact lookingat the display 102 and, hence, is providing an intentional input to thedevice 100.

In some instances, the peek gesture 208 may be used to displayadditional details regarding icons presented on the display 102. Thetilt gesture 210, meanwhile, may be used to navigate between center,left, and right panels. For instance, a tilt gesture to the right (i.e.,rotating the device 104 about the y-axis in a clockwise directionfollowed by a counterclockwise direction when viewing the device fromabove) may cause the device to navigate from the center panel to theright panel, or from the left panel to the center panel. A tilt gestureto the left (i.e., rotating the device 104 about the y-axis in acounterclockwise direction followed by a clockwise direction whenviewing the device from above), meanwhile, may cause the device tonavigate from the center panel to the left panel, or from the rightpanel to the center panel.

In addition to the peek gesture 208 and the tilt gesture 210, a user ofmay rotate the device 100 about the z-axis to perform the swivel gesture212. The swivel gesture may 212 comprise rotating the device more than athreshold angle (θ₃), while in other instances the swivel gesture 212may comprise rotating the device more than the threshold angle, θ₃, andthen beginning to rotate the device back towards its initial position(i.e., in the opposite direction about the z-axis 206), potentially bymore than a threshold amount. Again, the user-interface module maydetermine that a swivel gesture 212 has occurred based on informationfrom the gyroscope, from another orientation sensor, and/or from one ormore other sensors. For example, the user-interface module may alsoensure that a face or head of the user is present (based on informationfrom one or more front-facing cameras) prior to determining that theswivel gesture 212 has occurred. As described above, the swivel gesture212 may result in any sort of operation on the device 100, such assurfacing one or more icons.

Finally, FIG. 2 illustrates that a user of the device 100 may perform aroll gesture 214 by rotating the device 100 about the x-axis 202. Theuser-interface module 128 may identify the roll gesture similar to theidentification of the tilt and swivel gestures. That is, the module 128may identify that the user has rolled the device about the x-axis 202 bymore than a threshold angle (θ₄), or may identify that that the user hasrolled the device past the threshold angle, θ₄, and then has begunrolling it back the other direction. Again, the user-interface module128 may make this determination using information provided by anorientation sensor, such as the gyroscope, and/or along with informationfrom other sensors (e.g., information from one or more front-facingcameras, used to ensure that a face or head of the user is present).Alternatively, the roll gesture 214 may be detected entirely andexclusively using the optical sensors (e.g., front facing cameras).While the roll gesture 214 may be used by the device to perform an arrayof operations in response, in one example the roll gesture 214 causesthe device to surface one or more icons, such as settings icons or thelike.

In one example a user may be able to scroll content (e.g., text ondocuments, photos, etc.) via use of the roll gesture 214. For instance,a user may roll the device forward (i.e., so that a top half of thedevice is nearer to the user) in order to scroll downwards, and may rollthe device backward (so that a top half of the device is further fromthe user) in order to scroll upwards (or vice versa). Furthermore, insome instances the speed of the scrolling may be based on the degree ofthe roll. That is, a user may be able to scroll faster by increasing adegree of the roll and vice versa. Additionally or alternatively, thedevice may detect a speed or acceleration at which the user performs theroll gesture, which may be used to determine the speed of the scrolling.For instance, a user may perform a very fast roll gesture to scrollquickly, and a very slow, more gentle roll gesture to scroll moreslowly.

While a few example gestures have been described, it is to beappreciated that the user-interface module 128 may identify, incombination with the sensor-fusion module 126, an array of multipleother gestures based on information captured by sensors of the device100. Furthermore, while a few example operations performed by the device100 have been described, the device may perform any other similar ordifferent operations in response to these gestures.

FIG. 3 illustrates an example scenario 300 where a user performs, on themobile electronic device 100, a peek gesture to the left, a peek gestureto the right, a tilt gesture to the left, and a tilt gesture to theright. As illustrated, each of these gestures causes the mobileelectronic device to perform a different operation.

To begin, the electronic device 100 presents a “center UI” 302 on thedisplay 102. Thereafter, a user performs a peek gesture to the left304(1) by either rotating the device 100 in a counterclockwise mannerwhen viewed from the top of the device and/or by moving a head of theuser in corresponding or opposing manner. That is, because the device100 identifies the peek gesture using the four corner cameras 104(1)-(4)in some instances, the device identifies the gesture 304(1) bydetermining that the face or head of the user has changed relative tothe position of the device and, thus, the user may either rotate thedevice and/or move his or her head to the left in this example. Ineither case, identifying the change in the position of the user relativeto the device causes the device to perform an “operation A”. Thisoperation may include surfacing new or additional content, moving oraltering objects or images displayed in the UI, surfacing a new UI,performing a function, or any other type of operation.

Conversely, FIG. 3 also illustrates a user performing a peek gesture tothe right 304(2) while the device 100 presents the center UI 302. Asshown, in response the device 100 performs a different operation,operation B.

In still another example, a user of the device 100 may perform a tiltgesture to the left 304(3) when the device 100 presents the center UI(before or after performance of operation A). As described above, thedevice 100 may recognize the tilt gesture 304(3) based on data collectedby an inertial sensor, such as a gyroscope, accelerometer, or the like.For instance, the device 100 may determine that the tilt gesture hasbeen performed in response to determining that the user has rotated thedevice in the counterclockwise direction (when viewed from above) passeda threshold angle and then has begun rotating the device 100 back in theclockwise direction. In response to determining that the tilt gesturehas occurred, the device 100 may perform a predefined operationassociated with that gesture (here, “Operation C”).

Finally, FIG. 3 illustrates a user of the device 100 performing a tiltgesture to the right 304(4), which the device 100 may identify in amanner similar to how the device identified the tilt gesture 304(3).Here, however, the user rotates the device clockwise past a thresholdangle and then back in a counterclockwise direction. As illustrated, thedevice 100 performs an operation D on the device 100.

FIG. 4 illustrates an example scenario 400 where a user performs aswivel gesture on the device 100 and, in response, the device performs apredefined operation. As illustrated, the device 100 initially displaysa UI 402. At 404, the user begins to perform a swivel gesture byrotating the device 100 in either direction about the z-axis that isperpendicular to the display 102 of the device. As noted above, aninertial sensor may sense this rotation. After 404, the user rotates thedevice 100 about the z-axis in the opposite direction (counterclockwisein this example) and, in response, the device 100 identifies the gestureas a swivel gesture. In response to identifying the swivel gesture, thedevice performs an operation A, which, as discussed above, may compriseany sort of operation, including displaying or otherwise outputtingcertain content. While this example displays a swivel gesture to theright (given the initial clockwise rotation), in other instances theuser may perform a swivel gesture to the left, which may result in thesame or a different operation.

In some instances, the swivel gesture may require that a user rotate thedevice by more than a first threshold amount (e.g., 10 degrees), andthen back by more than a second threshold amount (e.g., 5 degrees). Inother instances, the device may detect a swivel gesture in response tothe user rotating the device by more than a threshold amount then backthe other direction by any amount.

FIG. 5 illustrates an example scenario 500 of the user interface (UI) ofthe device changing in response to a user selecting a physical homebutton on the device. In this example, the device 100 begins bydisplaying a UI 502 from an example application. While the device 100presents the UI 502, the user selects (e.g., depresses) a physicalbutton 504 on the device 100. This button 504 may comprise a “homebutton” that, when selected causes the device 100 to present a homescreen associated with the device 100. In this example, at 506 the usertaps or otherwise selects the button 504. In response, the device 100navigates to the home screen 508, which comprises a carousel of iconscorresponding to applications and/or content items (collectively,“items”).

The list displayed on the home screen 508 may comprise an interactivelist that is scrollable by the user of the device, such as by touchgestures on the display 102. For instance, the user may swipehorizontally to view different icons in the list, and a single icon inthe middle of the list and in front of the other icons may haveuser-interface focus at any one time. In some instances, the listcomprises a carousel that “loops”, such that a user is able tocontinuously spin the carousel in a circle, while in other examples thelist has two ends and may be scrolled leftwards and rightwards.

in response to the user again selecting, at 510, the home button 504,the device displays a UI comprising a grid of applications 512 availableto the device (e.g., stored locally on the device, remotely in thecloud, or both). In some instances the grid 512 is scrollablehorizontally or vertically to display as many pages as necessary topresent an icon associated with each application available to the device100. As illustrated, as the user selects the home button 504, the device100 toggles between displaying the home screen (e.g., with the carousel)and the application grid 512. Application icons may appear in the homecarousel 508, the application grid 512, or both.

FIGS. 6A-B illustrate example swipe gestures made from a bezel of thedevice and onto a display of the device. FIG. 6A, for instance, displaysan upwards swipe gesture 604 that begins at a bottom portion of a bezel602(1) of the device 100 and ends on the display 102. FIG. 6B,meanwhile, illustrates a downwards swipe gesture 606 that begins at anupper portion of the bezel 602(2) and ends on the display 102.

These respective gestures may be associated with the same or differentoperations. For instance, the gesture 604 may cause the device 100 tonavigate backwards to whatever task the device 100 was performing priorto the current task the device is performing at the time of the gesture604. This may include navigating backwards in a browser application,switching from a first application to a second application that the userwas previously consuming, or the like. Similarly, the gesture 604 maycause the device 100 to perform an sort of predefined operations.

FIGS. 7A-H illustrate an array of example swipe gestures that a user mayperform on the mobile electronic device 100. These respective gesturesmay be associated with any type of predefined operations, which may bespecific to whatever application a device is currently executing orwhich may be used consistently across all applications on the device.

FIG. 7A illustrates a basic tap on a touch-sensitive display, such asthe display 102. This may cause the device open a content item orotherwise perform a selection operation. FIG. 7B illustrates a doubletap, which comprises a user striking the touch-sensitive display (orother touch sensor) with an implement (e.g., a finger, stylus, pen,etc.) two times within a threshold duration of one another and within athreshold distance of another. This may allow a user to zoom in on acontent item (e.g., map, picture, etc.), to toggle a video aspect ratioof the display, to enter an immersive text view, or the like.

FIG. 7C, meanwhile, illustrates a tap-and-hold gesture. Here, the usertaps the display and keeps his or her finger on the display for athreshold amount of time. After the touch-sensor recognizes the user'sfinger or other element on the display for the threshold amount of time,the device 100 may recognize the tap-and-hold gesture and may perform acorresponding operation. For instance, pressing-and-holding may causethe device to launch a voice-recognition application to allow a user ofthe device 100 to provide a voice command to the device. This gesturemay also cause the device to present a camera button, may launch thecamera directly, may cause the device 100 to present a context menu oficons, or the like.

FIG. 7D illustrates a pinch-and-spread gesture, where a user places twofingers on the touch-sensitive display in close proximity to one anotherthen spreads his or her fingers out. This may cause the device 100 tozoom in on certain items, such as maps, photos, a browser, etc.

FIG. 7E, meanwhile, illustrates a horizontal swipe by a user, while FIG.7F illustrates a vertical swipe. A horizontal swipe may allow a user tonavigate an interactive list horizontally, to pan a map horizontally, tomove from one song to another song in a music application to fastforward or rewind in a video application, or the like. The verticalswipe of FIG. 7F, meanwhile, may allow a user to scroll a list or theapplication grid vertically, pan a map vertically, unlock the device100, answer a phone call, change a volume of the device, and the like.

FIG. 7G illustrates a drag-and-drop gesture, which may cause the device100 to give the appearance of the user grabbing and icon on the display102 and moving the icon where the user's finger or other implementtravels on the display. To do so, a user may tap-and-hold on the deviceand, after a threshold amount of time, may drag his or her finger orother implement across the display in the desired direction withoutlifting his or her finger or implement off of the display. When the userlifts the finger or implement off of the display, the device 100 mayconsider the gesture complete and may determine an operation to perform(e.g., where to display the icon) based on where the user removed his orher finger from the display 102.

Finally, FIG. 7H illustrates a multi-finger swipe gesture, where a userplaces two fingers onto the touch-sensitive display or other touchsensor and slides his or her fingers across the display 102 or touchsensor. In some instances, this gesture acts similar to one or more ofthe in-air gestures (e.g., swivel, peek, tilt, roll) in order to providea better experience to users that are unable to perform the in-airgestures comfortably. For instance, the multi-finger swipe gesture tothe right may navigate an application (or the home screen) from a centerpanel to a right panel, while such a gesture to the left may causedisplay of a corresponding left panel. This gesture may also adjust abrightness of the display 102 or may be associated with any otherpredefined operation.

FIG. 8 illustrates an example double-tap gesture 802 that a user mayperform on a back of the mobile electronic device 100. Here, a user mayperform this gesture 802 by tapping the device (e.g., with a finger) onthe back of the device, with the taps occurring within a thresholdamount of time of each other and within a threshold distance of oneanother. In some instances, an inertial sensor, such as anaccelerometer, a gyroscope, or both may detect both tap events and maydetermine: (1) whether they occurred within a threshold amount of timeof one another, and (2) whether they occurred within a thresholddistance of one another. If so, then the device 100 may determine that adouble-tap gesture 802 occurred and may perform a correspondingoperation. It is noted that while FIG. 8 illustrates a double-tapgesture, in other instances the device 100 utilizes gestures having anyother predetermined number of taps. Furthermore, while an accelerometeror gyroscope may be used to identify the gesture 802, in other instancesother sensors may be used to determine this gesture, such as a touchscreen or touch sensor on the back of the device 100.

FIG. 9 illustrates an example sequence of UIs 900 that the device 100may implement. The UI of the device may initially comprise a lock screen902. Upon a user unlocking the device (e.g., via a password, a swipegesture, biometric authentication, etc.), the UI may comprise a “homescreen” 904(1), which may include an interactive list as described above(e.g., the carousel), along with a grid of applications, which a usermay navigate via vertical swipe gestures. As described above, the homescreen 904(1) may comprise a center panel of a three (or more) panellayer of screens. From the home screen 904(1), the user may navigate toa left panel 904(2) or to a right panel 904(3). For instance, a user mayperform a tilt gesture to the left to navigate to the left panel 904(2)or may perform a tilt gesture to the right to navigate to the rightpanel 904(3). Conversely, the user may perform a multi-finger swiperight or left or may perform another predefined gesture to navigate tothese panels.

Additionally from the layer of screens 904, a user may navigate to aparticular application comprising a center panel 906(1), a left panel906(2), and a right panel 906(3). The center panel 906(1) may be thedefault screen for an application executable on the device and, as such,this panel may display the “primary content”. For instance, in abook-reading application, the center panel 906(1) may comprise thecontent of the electronic book. In a document processing application,the center panel 906(1) may comprise the content of the document, andthe like. Again, the user may navigate to the right and left panels viathe respective tilt gestures in some instances.

In some examples, a left panel 906(2) of an application may compriseuser-interface controls, which may include application-specificcontrols, device-generic controls (e.g., wireless settings, displaybrightness, etc.), or both. The right panel 906(3), meanwhile, maycomprise content that is supplementary to or related to the primarycontent displayed on the center panel 906(1). While a few specificexamples are discussed and illustrated below, it is to be appreciatedthat these are merely examples and many other possibilities exist.

FIG. 10 illustrates an example lock screen 1000 comprising a centerpanel 1002(1), a left panel 1002(2), and a right panel 1002(3). Asillustrated, the center panel 1002(1) may include certain information,such as a current date, time of day, notifications, and the like. Thenotifications may include a number of new messages (e.g., emails, textmessages etc.) that the user has received, a number of new voicemails,meeting reminders, and the like.

In addition, the user may learn additional information about what isdisplayed on the center panel 1002(1) by navigating to the left panel1002(2). In some instances, the user may navigate to the left panel byperforming a tilt gesture to the left. As illustrated, the left panel1002(2) of the lock screen 1000 includes additional informationregarding the notifications, such as expanded information regarding thereceived messages, received voicemails, and impending meetings. For themessages, this additional information may include an indication of asender of each message, other recipient(s) of each message if any, asubject of each message, a part or all of the content of each message,and/or the like. The additional information for the voicemail mayindicate who the voicemail is from, when the device 100 received thevoicemail, a length of the voicemail, and/or the like. For the meetingreminder, the additional information may include a title of the meeting,a location of the meeting, when the meeting is scheduled to occur,and/or the like. In addition, because the object representing thecurrent time of day (6:45) is a 3D-modeled object, performing the tiltgesture to the left causes this object to be oriented differently, as ifthe user were seeing a left side of the object.

Furthermore, the user may navigate to the right panel 1002(3) of thelock screen 1000 by performing a tilt gesture to the right. In thisexample, the right panel 1002(3) shows music that the device iscurrently playing, along with some controls for controlling the music.Again, some of the objects, including the time, the controls, and thealbum cover comprise 3D-modeled objects and, therefore, the orientationand shadowing of these items may change as the user changes his or herposition relative to the device 1000. In other examples, right panels ofthe lock screen may display information of one or more currently openapplications (e.g., games, weather, timers, alarms, etc.).

FIGS. 11A-E illustrate an example home screen of the device. Here, thehome screen comprises an upper portion having a carousel 1100 that auser is able to navigate via swipe gestures on the display 102. Asillustrated, content associated with an item having focus on thecarousel may be display in a lower portion beneath the carousel. As anitem having focus in the carousel is changed or updated, so too does theinformation in the lower portion.

FIG. 11A illustrates the carousel 1102 when an icon 1104(1)corresponding to an email application has user-interface focus. That is,the icon 1104(1) is centered and in front of each other icon in thecarousel 1102 and, therefore, has the user-interface focus. Asillustrated, the lower portion of the display includes additional items1106(1) associated with the email application. In this instance, theseitems comprise email messages, such as the most recently receivedemails.

FIG. 11A further illustrates that the user may scroll the carousel 1102horizontally, and in this instance to the left. As such, FIG. 11Billustrates that an icon 1104(2) corresponding to mapping applicationcurrently has user-interface focus. As such, the lower portion of thedisplay 102 presents additional items 1106(2) associated with themapping application, such as recent geographical searches conducted onthe application.

FIG. 11C illustrates that the user has again scrolled the carousel tothe left, such that an icon 1104(3) corresponding to a photo-galleryapplication now has user-interface focus. As such, the lower portionpresents additional items 1106(3) associated with the application havingthe user-interface focus. Here, the additional items 1106(3) maycomprise recent pictures that the user has taken using a camera of thedevice. FIG. 11C further illustrates that the user is able to scroll theadditional items 1106(3) in the lower portion via vertical swipegestures.

FIG. 11D illustrates that the user has again scrolled the carousel toleft, such that an icon 1104(4) corresponding to a calendaringapplication now has user-interface focus. As such, the lower portion nowpresents items 1106(4) associated with the calendaring application.Here, these items comprise upcoming meetings for the day. Again, thisday-view shown in the lower portion of the display 102 may be navigableby the via vertical swipe gestures on the display 102.

FIG. 11E illustrates how the carousel 1102 may promote, towards or tothe front of the carousel 1102, those items having notifications for theuser. In the first screen shot, an icon 1104(5) corresponding to a birdgame currently has user-interface focus, while an icon 1108corresponding to messaging application is next in line in the carousel.Note that in the first screen shot, the messaging application does nothave any current notifications.

Next, the second screen shot illustrates that the messaging applicationnow has a notification, potentially indicating the receipt of a newmessage. As such, the icon 1108 includes a “1”, indicating one newmessage. As such, in response to a user input, or potentiallyautomatically and without user input, the device may reorder thecarousel 1102 to promote (i.e., move nearer or to the front of thecarousel 1102) those icons associated with applications having current,unread notifications. For example, the second screen shot illustratesthe user tapping, at 1110, the physical home button of the device 100.In response, and as shown in the third screen shot, the carousel 1102has now been reordered such that the icon 1108 corresponding to themessaging application is now at the front of the carousel and hasuser-interface focus. As such, while illustrated as blank in each of thethree screenshots, the lower portion of the display on the home screenmay present items associated with the messaging application—such as thenewly received message.

FIG. 12 illustrates an example where information related to an itemhaving focus in the carousel is initially displayed underneath an iconof the item. In response to a user performing a gesture (e.g., a swipegesture), additional information related to the item may be displayed onthe device.

As illustrated, the display 102 initially displays a carousel of icons1202, information 1204(1) related to an icon currently havinguser-interface focus, and a row of icons 1206. In this instance, theicon having user-interface focus corresponds to a messaging application,such as a text-messaging application. As such, the information 1204(1)includes an indication of a number of new messages and a portion of anewest message (including an identifier of the sender).

As illustrated, a user of the device 100 performs an upwards swipegesture 1208 from the information 1204(1) towards the icon having theuser-interface focus. In response, as shown in the second screen shot,additional information 1204(2) regarding the application associated withthe icon having the user-interface focus is displayed. For instance,multiple new messages are now displayed, along with an identifier ofeach sender, rather than a single message. In addition, the icon in thecarousel 1202, as well as the carousel 1202 itself, has been reduced insize on the display. Thereafter, the user may perform a downwards swipegesture 1210 to return the UI shown in the first screen shot.

FIG. 13A illustrates an example home screen 1300, which includes acarousel 1302 at a time when an icon associated with an emailapplication has user-interface focus. As such, a lower portion of thehome screen 1300 includes items 1304 associated with the emailapplication. Here, for instance, the items comprise most recentlyreceived email messages, and the emails indicate a sender and alsoinclude a portion of the message. In addition, the icon havinguser-interface focus in the carousel includes a badge 1306, which mayprovide any sort of application-specific information. Here, forinstance, the badge 1306 indicates that the email application currentlyhas six new email messages.

FIG. 13A also illustrates a left panel 1308 that the device 100 maydisplay in response to a user performing a tilt gesture to the left fromthe home screen 1300. Here, the left panel comprises a “librarypicker”—that is, selectable icons associated with each content-itemlibrary available to the electronic device 100. For instance, eachillustrated word in the left panel 1308 may be associated with acontent-item library, such that selection of a particular icon causesthe device 100 to display icons corresponding to the content items ofthe respective library. The content-item libraries may include ashopping library showing items that the user has purchased or has addedto a list (e.g., a wish list), a people library illustrating contactsand corresponding contact information, an application libraryillustrated applications available to the device (and/or available forpurchase), a games library, a photo-gallery library, a music gallery, abook library for electronic books, a newsstand library for periodicals,a video library, and an audio-book library.

Furthermore, FIG. 13A illustrates a right panel 1310 that the user maynavigate to from the home screen 1300 in response to performing a tiltgesture to the right. The right panel 1310 may comprise a grid ofapplications, in some instances. The applications may comprise eachapplication available to the device, applications having been deemedfavorites of the user, applications having been recently accessed, orthe like.

Furthermore, each icon in the application grid may comprise a 3D-modeledobject. As such, when a position of a head or face of a user changesrelative to the display of the device, the display 102 may alter displayof the 3D icons, as described above.

FIG. 13B illustrates an alternative right panel 1312 from theimplementation of FIG. 13A. Here, the right panel 1312 may includecurrent information that the device 100 determines is currentlypertinent to the user. This may include current weather, currentnotifications, upcoming meetings, status of one or more orders, and thelike. FIG. 19, described below, more fully implements potential elementsof the example right panel 1312.

FIG. 14 illustrates another example home screen comprising a carousel1402 and items 1404 associated with an application corresponding to anicon currently having user-interface focus. In addition, the home screen1400 includes a row of icons 1406, corresponding to a phone application,a browser application, a text messaging application, and an emailapplication.

FIG. 14 illustrates the user performing an upwards swipe gesture 1408beginning at the row of icons 1406. In response, the device 100 displaysa grid of applications 1410, which may comprise all applicationsavailable to the device, applications that the user has deemedfavorites, applications recently accessed, or the like.

FIG. 15 illustrates an example where the device toggles betweendisplaying a home screen 1500 and displaying an application grid 1502 inresponse to a user selecting a physical home button 1504 on the device.As illustrated by the first screen shot, at 1506 the user taps the homebutton 1504. In response, the device 100 navigates from the home screento the application grid 1502. Further, the user then selects, at 1508,the home button 1504 again, thus causing the device to navigate back tothe home screen 1500. As such, the user is able to toggle between thehome screen (that includes the carousel) and the application grid byselecting the physical home button on the housing of the device 100.

FIG. 16 illustrates an example operation that the device may perform inresponse to a peek gesture. Here, the UI of the device initiallydisplays a screen 1600 comprising icons corresponding to favorite itemsof the user. in response to the user performing a peek gesture 1602, thedevice 100 displays a screen 1604, which includes additional detailsregarding the favorite items. That is, in response to the userperforming the peek gesture 1602, the device 100 updates the display 100to include additional details regarding applications and content itemsassociated with items in the favorites screen 1600. These additionaldetails may include a name of the application, a size of theapplication, any notifications associated with the application, when theapplication was last accessed, or any other type of information.

FIG. 17 illustrates an example in which a user of the device is able tocause the UI of the device to transition from displaying iconscorresponding to applications stored on the device to iconscorresponding available to the device but stored remotely from thedevice. To begin, FIG. 17 illustrates a screen 1700 that depicts iconsassociated with applications that are stored locally on the device 102,as well as an icon 1702 that allows the user to toggle between viewingicons associated with applications stored on the device, andapplications remotely “on the cloud”. As illustrated, after the userselects to view applications stored on the cloud, the device 100 mayupdate the display to show a screen 1704 having icons associated withapplications stored remotely from the device 100. In addition, in someinstances both the screen 1700 and the screen 1704 may display a row orother grouping of icons 1706, such that these applications areaccessible to the user regardless of whether the user has chosen to viewapplications stored on the cloud or applications stored locally. Theseicons may correspond to the row of icons 1406 shown in FIG. 14, with theapplications including a phone application, a browser application, atext messaging application, and an email application.

FIG. 18 illustrates example UIs that the device may display when a userlaunches a book application on the device. As illustrated, a centerpanel 1800 currently illustrates icons corresponding to books availableto the device, either stored locally or remotely on the cloud.Responsive to a user selecting an icon associated with a particularbook, the device 100 may display content of the respective book. Inaddition, the center panel 1800 includes an icon 1802 that, whenselected, instructs the device 100 to display books available foracquisition (e.g., purchase, rent, lease, borrow, etc.). That is,selection of the icon 1802 may cause the device to navigate to a storewhere additional books may be acquired. Finally, the center panel 1800currently illustrates one or more badges 1804 associated with respectivebook icons. The example icons illustrate that one book is new, one bookis actually a sample of a book, and 46% of one book has been read by theuser of the device. In some instances, the center panel 1800 displaysthese badges in response to a user performing a peek gesture.

FIG. 18 also illustrates a left panel 1806 that the device 100 maydisplay in response to a user performing a tilt gesture to the leftwhile the device displays the book application in the center panel 1800.As illustrated, the left panel 1806 includes settings associated withthe book application. For instance, the left panel allows the user tosort books of the user according to whether they are stored on the cloudon the device.

The user may also cause the device 100 to present a right panel 1808 byperforming a tilt gesture to the right while the device displays thecenter panel 1800 (or may perform two tilt gestures to the right whilethe device 100 displays the left panel 1806. In this example, the rightpanel 1808 includes icons corresponding to books that are recommendedfor the user. In instances, a service that offers these books foracquisition determines which books to include on the right panel 1808,based on books previously book or read by the user, the books currentlyon the device 100 or stored in the cloud in association with the device100, or based on any other known information regarding the user of thedevice.

FIG. 19 illustrates an example UI 1900 that the device 100 may display.This UI includes certain information that may be currently pertinent tothe user, such as a current weather 1902 near the user of the device 100and upcoming meetings 1904 from a calendar of the user. In addition, theUI 1900 may include a section 1906 indicating messages that have beenmissed at the device. These messages may be grouped by application(e.g., text messages, emails, phone calls, etc.) and may be sorted byrecency or age of the messages. In addition, the UI 1900 may indicate astatus 1908 of any orders of the user (e.g., orders from an onlinemerchant) and may also include an indication 1910 of content availableto the user or the device (e.g., newly released content to which theuser has a subscription to), and the like. While FIG. 19 illustratesseveral example pieces of information that may be of current interest tothe user, it is to be appreciated that this UI 1900 may include anyother type of information.

FIG. 20 illustrates an example settings UI 2000 that the device 100 maydisplay. As illustrated, this UI 2000 may include a group of icons 2002for managing certain settings on the device 100. For instance, the icons2002 allow a user to search their content and applications storedremotely from the device (i.e., in the cloud), to contact a customerservice representative for help operating the device 100 (the “mayday”icon), to change wireless settings associated with the device, to turnon a “flashlight” using a light of the device, to sync the device 100storage with a portion of cloud storage, to switch the device into anairplane mode, to change a Bluetooth setting of the device, and tolaunch a general device-settings menu for the device 100. In addition,the UI 2000 includes a dimmer bar 2004 for adjusting brightness of thedisplay, as well as an icon that, when selected, causes the device toautomatically adjust the display brightness based on ambient lightingconditions.

Finally, the UI 2000 may include a portion 2006 that indicates a list ofrecent notifications for the device 100. These notifications may includemissed calls, new emails, new text messages, calendar notifications,notifications of captured screen shots, and the like.

FIG. 21 illustrates an example scenario where a user requests to launcha search from the UI 2000 illustrated in FIG. 2A. As illustrated, whenthe user of the device 100 selects (e.g., via a touch gesture on thedisplay 102) the search icon, the device 100 displays the second UI2100. The second UI 2100 may display recent searches conducted by theuser. As the user begins to type, the UI 2100 may begin to providesearch suggestions 2102. As illustrated, these search suggestions may begrouped by item type, such as applications, games, books, and the like.Here, the user has typed “Be” and, in response, the device 100 suggestssome items that include these letters.

FIGS. 22A-F Illustrate different three-dimensional (3D) badges that thedevice may display atop or adjacent to icons associated with certainitems. These badges are dynamic and can change based on parameters, suchas how much of the respective item a user has consumed, or the like.Because these badges are 3D-modeled objects, a user may be able to viewdifferent sides of the objects may changing the position of the userrelative to the display, as determined by information captured by thecorner cameras. In some examples, viewing the badges from differentangles may display different information. For instance, viewing aprogress bar from the top may display a user's total progress throughthe item, whereas viewing the progress bar from below may display theuser's progress during a most recent consumption session.

FIG. 22A, for instance, illustrates a badge that indicates that a userhas finished 43% of the book. This badge, like each other illustratedbadge, has been modeled specifically to fit the 3D-modeled iconrepresenting the book. FIG. 22B, meanwhile, illustrates a book havingmultiple badges. First, the book includes a badge indicating that thebook is “new”—that is, that the user has not yet opened the book on thedevice 100 (or another device associated with an account of the user ofthe device). In addition, the book includes a progress-bar badgeindicating a current location of the user in the book, along with acontrol (“x”) that, when selected,” removes the progress-bar badge fromthe book. The progress bar, and the percentage of FIG. 22A, maydynamically update as the user reads through the book.

FIG. 22C, meanwhile, includes a badge indicating that the iconrepresents a book. FIG. 22D includes a badge indicating that the movieis in a high-definition format, as well as that certain members of aprogram (Amazon Prime®) are able to view the movie without additionalcharge. FIG. 22E includes a badge associated with an email-applicationicon indicating how many unread messages the user has in his or heremail account. Again, this number may dynamically update based onreceipt of incoming mail. Finally, FIG. 22E illustrates a badge on amusic-album icon indicating a genre of music of the album (rock). Whilea few example badges have been described, it is to be appreciated thatmultiple other badges are possible.

FIG. 23A illustrates an example scenario 2300 where a user performs aswivel gesture while the device is displaying a UI 2302 corresponding toan application accessible to the device. In response to the swivelgesture, the device may display a system chrome 2304 for operation by auser of the device. As shown, the system chrome 2304 may appear to slidein from a side of the display 102 and may finally stop at a locationapproximately in the middle of the width of the display. The systemchrome 2304 may include an icon to search the device or the cloud, tonavigate back to a previous location (within and across applications),and to launch a more detailed settings menu. In some instances, the usermay be able to cause display of the system chrome at any point in time,regardless of the current application being executed on the device 100,by performing the swivel gesture. Furthermore, and as will beappreciated, while several example icons are described, the systemchrome may display any other similar or different type of icon. In someinstances, the system chrome remains for a predefined amount of timeafter performing the predefined gesture (e.g., three seconds) afterwhich the display 102 may be updated to remove the system chrome.

FIG. 23B illustrates an example scenario 2306 where a user performs aroll gesture while the device is displaying a UI 2308 corresponding toan application accessible to the device. In response to the rollgesture, the device 100 may display a “quick settings” menu 2310 foroperation by a user of the device. In some instances, the quick-settingsmenu 2310 may comprise an alternative or an additional menu to thesystem chrome 2304. As illustrated, the quick-settings menu may allow auser to change a ring setting, place the device 100 into airplane mode,change a brightness of the device, change a wireless setting of thedevice, turn on a light as a flashlight, or connect the device toBluetooth. Of course, while a few examples have been provided, it is tobe appreciated that the menu 2310 may include any other different orsimilar icons.

FIG. 24 illustrates another example scenario 2400 where a user performsa swivel gesture while the device is displaying a UI 2402 correspondingto an application accessible to the device. In response to the swivelgesture, the device 100 may display, in part, icons corresponding tocertain application launch controls 2404 that, when selected, cause thedevice 100 to launch the corresponding applications. In some instances,the application launch controls 2404 may be presented along asubstantially arc-shaped path, which may position the icons within easyreach of where a user's thumb or finger is likely to be while performingthe swivel gesture. The arc may be centered around a lower corner of thedisplay screen, or may be centered around a detected location of one ormore fingers of the user (e.g., detected by a touch screen or touchsensor of the device), for example.

As illustrated, these applications may include a phone application, atext-messaging application, an email application, a map application, anda browser application. Of course, while a few examples have beenprovided, other implementations may include any other similar ordifferent application launch controls. In some instances, the particularapplication launch controls may be chosen or set by the user.

FIG. 25 illustrates another example operation that the device mayperform in response to a user performing a swivel gesture. In thisexample, the operation is based in part on a location of the user.Specifically, the device displays information 2500 regarding arestaurant that the user is currently located at and further displaysfunctionality to allow a user to “check in” at or “like” the restauranton a social network. In some instances, this information 2500 may bedisplayed when the device 100 is executing a particular application,while in other implementations the information 2500 may be presentedacross any and all applications. That is, the information 2500 may bepresented based on the user's geo-location (as determined by one or morelocation components of the device 100) rather than based on a particularapplication that the user is executing on the device 100.

FIG. 26 illustrates another example geo-based operation that the devicemay perform in response to a user performing a swivel gesture. Here, thedevice displays a map 2600. The map may be of the current location ofthe user, a destination of the user, or the like. Again, the map 2600may be displayed in response to the swivel gesture when the device 100is executing a particular application (e.g., a mapping application),while in other instances the map 2500 may be displayed without referenceto an underlying application. In some instances, performing a swivelgesture or another gesture may cause the device 100 to present trafficinformation corresponding to one or more routes presented on the map. Instill other instances, the map may comprise a map of a locationfrequently traveled to by a user of the device, may comprise a map of alocation at which a user has an upcoming meeting or appointment (e.g.,the next meeting on the user's calendar), or the like.

While FIG. 25 displays the map 2500, in other implementations othergeo-based information may be displayed in response to a swivel gestureor another predefined gesture. For instance, the device 100 may presentbusinesses (e.g., restaurants) or other points of interest that arewithin a particular proximity of the user. Or, performing a swivelgesture may cause the device to present a UI to allow the user to“share” his or her location with his or her social network. In anotherexample, performing the swivel gesture may cause the device to“remember” the location of the user. That is, the device 100 maybookmark or pin the location on a map for later viewing by the user.

In still other examples, the device 100 may display notifications inresponse to the user performing a swivel gesture. These notificationsmay indicate new messages received, missed calls, updates needed, andthe like. In still another example, the device 100 may display a panelof information that includes some or all of the information discussedabove with reference to FIG. 19. Again, while a few example operationshave been described, it is to be appreciated that multiple otheroperations may be performed in response to the user performing a swivelgesture or any other type of predefined gesture.

FIG. 27 illustrates an example UI 2700 of a home screen of the device100. As illustrated, the UI 2700 includes a carousel of icons 2702 thatis navigable by a user of the device. The UI 2700 also includes a lowerportion 2704, which displays additional information. As illustrated,when an icon has user-interface focus, information associated with anitem corresponding to the icon is displayed beneath the carousel. Thatis, whatever item has user-interface focus populates the lower portion2704 with additional information. Here, the icon corresponding to anemail application has user-interface focus in the carousel 2702 and,therefore, the lower portion 2704 includes the most recently receivedemails for the corresponding email account. As illustrated and asdiscussed above, the carousel may be navigable horizontally via touchgestures on the display 102, while the information in the lower portionmay be navigable vertically via touch gestures on the display 102. Inaddition, the icons in the carousel 2702 comprise 3D-modeled objects,and may include 3D or 2D badges.

FIG. 28 illustrates an example UI 2800 within an email application. Asillustrated, this UI 2800 comprises an inbox of a user, which listsemails received by the user. In addition, this figure illustrates thatthe device 100 may display another UI 2802, which includes additional ordifferent information regarding messages in the inbox, in response to auser performing a peek gesture on the device 100. That is, when a useris viewing an inbox, the user may perform a peek gesture (e.g., to theright or left) to cause the device to display additional or differentinformation. In this case, the additional information comprises more ofeach message. In addition, the UI 2802 has removed some information ascompared to the information in the UI 2800. For instance, the UI 2800includes an identifier of the send and a time of receipt, while the UI2802 does not. As such, the peek gesture is effective to remove certaininformation to make room for more of the actual content of the emailmessages in the inbox.

FIG. 29 illustrates an example UI 2900 of an inbox of an emailapplication, in addition to potential right and left panels that thedevice may display in response to predefined gestures (e.g., a tiltgesture to the right and a tilt gesture to the left, respectively). Asillustrated, the UI 2900 lists multiple messages in the user's inbox. Byperforming a tilt gesture to the left, however, the device 100 maydisplay a left panel 2902. The left panel 2902 may comprise a settingsmenu that allows a user to manage the email account of the user.

By performing a tilt gesture to the right from the center panel 2900,however, the user is able to view a right panel 2904. The right panel2904 comprises a grouping of email messages by senders. That is, theright panel 2904 includes an indication of a total number of emailswithin the inbox. Underneath this indication, the right panel 2904includes a list of the “top senders”—that is, senders that have sent thelargest number of emails to the inbox. The right panel 2904 ranks thesesuch that the sender who has sent the most emails is listed first and soforth. In addition, selection of a sender may cause the device 100 todisplay, according to recency, emails received from that particularsender.

FIG. 30 illustrates an example right panel 3000 that the device 100 maydisplay in response to a user performing a tilt gesture to the rightwhile viewing an inbox from the mail application. In this example, whenthe user performs a tilt gesture to the right, the device 100 displaysicons corresponding to one or more attachments that are attached toemails in the inbox. These icons may be selectable such that selectionof a corresponding icon causes the device 100 to save or output theattachment, or ask if the user would like to perform some actionregarding the attachment. In some instances these attachments may besorted based on recency of the corresponding emails (e.g., attachmentsfrom most recent emails displayed first and so forth), size of theattachments, or the like.

FIG. 31 illustrates an example center panel 3100 showing a usercomposing a new mail message. In this example, when the user performs atilt gesture to the left, the device 100 again displays a left panel3102 that comprises a settings menu that allows a user to manage theemail account of the user. When the user performs a tilt gesture to theright, however, the device 100 displays a list of contacts 3104 in thisexample. As illustrated, the user may select which contacts of the listhe or she would like to send the email to. This right panel 3104 mayaccordingly be scrollable in the vertical direction in this example(e.g., via touch gestures on the display). In some instances, cursor ofthe user may be in the “to:” line in order for the tilt gesture to theright to display the list of contacts in the right panel 3104.Furthermore, the list of contacts may be populated based on a contactsapplication, a list of previous recipients of emails from the user ofthe device 100, or the like. Further, the list of contacts may be sortedalphabetically, based on a number of times that the user has sent emailsto each particular contact, or the like.

FIG. 32 illustrates another example where a user is composing an emailin a center panel 3200. Again, the device 100 may display a settingsmenu in a left panel 3202. In response to the user performing a tiltgesture to the right, however, the device may display a right panel thatincludes files (in this case, photos) to attach to the email message.For instance, the device 100 may display photos from a photo gallery ofthe device 100 for selection by the user, potentially sorted accordingto recency with most recently taken photos appearing first. In responseto the user of the device 100 selecting one or more photos from theright panel 3204, the device 100 may attach those photos to the emailmessage being composed in the center panel 3200.

FIG. 33 illustrates two example right panels 3300 and 3302 that thedevice 100 may display in response to a user performing a tilt gestureto the right from an open email message received from or sent to aparticular user, or from an email that has been highlighted in a list(as illustrated in the example inbox). As illustrated, each right panel3300 and 3302 displays other emails sent and/or received from theparticular contact that sent the subject email in the center panel (orto whom the user sent an email to, in the case of a sent message). Inthe right panel 3300, the device 100 displays those emails that are toor from the contact and that stored on the device. The right panel 3302,meanwhile, display those emails that are to or from the contact and thatare either stored on the device 100 or stored on a server that is remotefrom the device 100 (i.e., stored in the cloud).

FIG. 34 illustrates another example right panel 3400 that the device maydisplay from an open email message that the device has received (orsent), or from an email highlighted in a list (as illustrated). Inresponse to the user performing a tilt gesture to the right, the device100 may display the right panel 3400, which allows the user to reply tothe sender or to one or more other parties. As such, when a user views areceived email on the display 102, the user need only perform a tiltgesture to the right to open a window to compose a reply email to thesender.

FIG. 35 illustrates an example center panel 3500 showing a meetinginvitation, as well as potential right and left panels that the devicemay display in response to predefined gestures (e.g., a tilt gesture tothe right and a tilt gesture to the left, respectively). As illustrated,the center panel 3500 includes details of the propose meeting, includinga location and time, as well as controls that allow a user to respond tothe invitation. In response to the user performing a tilt gesture to theleft, the device 100 may display the left panel 3502, which againcomprises a settings menu that allows a user to manage his or her emailaccount (and potentially calendar). In response to performing a tiltgesture to the right when in the center panel 3500, however, the device100 may display the right panel 3504. As illustrated, the right panel3504, in this example, shows the calendar of the user populated withcurrent appointments of the user on the day at which the proposedmeeting is to occur. In this example, the right panel 3504 also shows,within the calendar, the proposed meeting. As such, the user is able toeasily see how the proposed meeting fits in with the rest of his or herschedule. In addition, the right panel 3504 includes controls for a userto reply to the invitation with a reply of accept, decline, or maybe.

FIG. 36 illustrates another example right panel 3600 that the device maydisplay in response to a user performing a tilt gesture to the rightwhile the device displays a meeting invitation. This figure illustratesan alternative right panel 3600, which does not include the controls forreplying to the invitation but instead lists the invitation on thecalendar as a “new appointment”.

FIG. 37 illustrates an example right panel 3700 that the device maydisplay in response to displaying a tilt gesture to the right while thedevice 100 displays a calendar. In this example, when the user performsthis gesture while viewing a calendar, the device 100 displaysinformation regarding the next meeting of the user. That is, the rightpanel 3700 displays details, such as the title, time, location, andother attendees, of the meeting that is the next meeting on the calendarof the user. Further, as illustrated, the right panel may include one ormore controls that allow a user to compose a “quick message”, either byselecting an icon and typing a message to some or all attendees ororganizers of the meeting, or by simply selecting a pre-written message.For instance, the right panel 3702 includes several example messagesthat the device 100 may send to one or more people associated with themeeting in response to selection of the message, such as “Go ahead andstart without me” and the like. Therefore, a user is able to not onlyview his or her impending meeting with a gesture of the device 100, butalso able to quickly email other interested parties by selecting an iconon the right panel 3704.

FIG. 38 illustrates an example central panel 3800 showing a messagingsession (e.g., text messaging) between a user of the device and anotherexample user (“Maggie Lynn”). In this example, in response to performinga tilt gesture to the right, the device may display a right panel 3802,which comprises icons associated with photos that the user of the device100 has either sent or received as part of the conversation in thetext-messaging session with Maggie Lynn. That is, by performing the tiltgesture from within the conversation panel, the user of the device 100is able to see each picture that the two users in the messaging sessionhave shared with one another. These photos may be ordered by recency,size, or the like. Furthermore, selection of an icon corresponding to aphoto may cause the device 100 to display the photo, store the photolocally, or present a menu querying the user as to what operation theuser would like the device 100 to perform. In some instances,applications such as a text-messaging application, might not implement aleft panel (or, conversely, may implement a left panel but no rightpanel).

Furthermore, while FIG. 38 illustrates an example of a messaging sessionbetween two users, in some instances a center panel may comprise a listof contacts to whom the user of the device has sent or received textmessages from. In this instance, in response to a user performing a tiltgesture to the right, the device may display a list of photos sent orreceived from each of the contacts in the list.

FIG. 39 illustrates an example UI 3900 of a home screen that includes acarousel of icons 3902 that is navigable by a user of the device 100. Inthis example, an icon 3904 corresponding to a book that the user haspartially read currently has user-interface focus in the carousel 3902.In this example, the icon 3904 represents the book-reading application,and selection of icon 3904 may launch the corresponding application andwell as the book corresponding to the icon 3904.

In addition, because the icon corresponding to the book applicationcurrently has user-interface focus, the information in a lower portion3906 of the UI 3900, beneath the carousel, comprises recommended booksfor the user that have been identified from the book corresponding tothe illustrated icon. That is, in this example, the lower portion of theUI 3900 recommends certain books to the user based on the bookillustrated in the carousel and/or based on other books stored on thedevice or previously read by the user. In some instances, selection of abook from the lower portion 3906 may cause the device 100 to navigate toa store from which the user may acquire the corresponding book oranother book. Furthermore, in some instances the user of the device 100may navigate the items in the lower portion 3906 of the UI 3900 byvertical swipe gestures on the display 102.

FIG. 40 illustrates an example UI 4000 of a store and displays booksavailable for acquisition by the user. As illustrated, the UI 4000includes an icon for the book (e.g., a cover for the book), as well as aname of the book and an author. In this example, the user performs apeek gesture to cause the device 100 to display a right panel 4002,which includes additional details regarding the books. For instance, theright panel 4002 adds a rating for each book along with a price for eachbook in the store. While a few example details are shown, it is to beappreciated that multiple additional or alternative details may bedisplayed in response to the user performing the peek gesture.

Furthermore, in instances where the center panel displays books from thelibrary of the user, different details may be displayed in response tothe user performing the peek gesture. For instance, the right panel maydisplay a user's progress through the book, expressed via a progressbar, a percentage, or the like.

FIG. 41 illustrates an example UI 4100 showing books available to thedevice or available for acquisition by the user. That is, the UI 4100may comprise an interface that a store may present in response to a usernavigating to the store and browsing within an electronic catalog of thestore. In addition, FIG. 41 illustrates that the user has performed atilt gesture to the left and, in response, the device 100 displays aleft panel 4102 comprising a navigation menu. As illustrated, thenavigation menu 4102 includes links that allow the user to navigatewithin his or her own library, as well as within the store.

In addition, FIG. 41 illustrates that the user has performed a tiltgesture to the right and, in response, the device 100 has displayed anexample right panel 4104. In this example, the right panel 4104comprises additional books available for acquisition for considerationby the user. More specifically, the right panel 4104 illustrates “bestsellers” within a category of the electronic catalog that the user iscurrently viewing in the center panel 4100, as well as relatedcategories or sub-categories. As such, the user is able to viewbest-selling books in a category that he or she is browsing in responseto performing the tilt gesture to the right. In some instances, theadditional content shown in the right panel 4104 may instead compriserecommend items or the like.

FIG. 42 illustrates an example UI 4200 showing content from within abook accessible to the device. That is, the UI 4200 may be displayed inresponse to a user requesting to read a book that is accessible to thedevice. In addition, FIG. 42 displays an example left panel 4202 thatthe device 100 may display in response to the user performing a tiltgesture to the left when the book content is displayed in the centerpanel. As illustrated, the left panel 4202 may include a navigation menuthat allows the user to navigate through the book that he or she iscurrently reading. For example, the navigation menu may include a tableof contents that includes links corresponding to locations within thebook that the user is currently reading that, when selected, cause thedevice the navigate to the selected location. The left panel 4202 mayinclude additional information regarding the book, such as a name of thebook, an author of the book, a length of the book, a current location ofthe book, and the like. The left panel 4202 also includes a link thatallows a user to request to navigate to any particular location withinthe book (“Go to Page or Location”) as well as a link that allows theuser to display the furthest page that the user has reached in the book,whether on the device 100 or another device associated with an accountof the user (“Sync to Furthest Page Read”).

FIG. 42 also illustrates an example right panel that the device 100 maydisplay in response to the user performing a tilt gesture to the rightwhile reading the book in the center-panel UI 4200. The right panel mayinclude any sort of additional information regarding the books, such asan outline of the book, commentary associated with the book, author'snotes, highlights made by other users at the particular location of thebook, or the like. In this example, the right panel 4204 includes“X-Ray” data, which includes information regarding people, places, orthings mentioned in the particular page that is rendered on the UI 4200.That is, the X-Ray data may comprise additional information regardingcharacters or other “people, places, or things” referenced in the book,with this additional information comprising an indication of where this“person, place, or thing” was first referenced in the book, additionalplaces throughout the book where this person appears, and the like. Insome instances, each person, place, or thing referenced in the rightpanel 4204 is selectable to view additional information than is shown inthe right panel 4204. In other instances, the information in the rightpanel 4204 may be selectable to navigate to a particular portion of thebook that references the respective person, place, or thing, such as aplace where the book introduces the respective person, place, or thing.Finally, in some instances, a user may be able to view, within thecenter-panel UI 4200, which people, places, or things have X-Ray dataassociated with them by performing a peek gesture from the UI 4200. Inresponse, the device may highlight each person, place, or thing forwhich the device has information for display within the right panel4204. Therefore, a user may perform a peek gesture to determine whethera particular character or location in the book, for example, isassociated with X-Ray information and, if so, the user may perform atilt gesture to the right to view this X-ray information. Further, asshown in center panel 4200, the device 100 may highlight the nouns orother information on the page of the electronic book, in response to apeek gesture, for which this X-Ray data is available.

FIG. 43 illustrates an example UI 4300 of a home screen that includes acarousel of icons 4302 that is navigable by a user of the device 100. Inthis example, an icon 4304 corresponding to a particular music albumthat the user owns has user-interface focus in the carousel 4302. Inthis example, the icon 4304 represents a music application, andselection of icon 4304 may launch the corresponding application and wellas the music album corresponding to the icon 4304.

In addition, because the icon corresponding to the music applicationcurrently has user-interface focus, the information in a lower portion4306 of the UI 4300, beneath the carousel, comprises individual tracksthat are on the music album corresponding to the UI 4304. These tracksmay be scrollable via swipe gestures in the lower portion 4306.Furthermore, in some instance the lower portion 4306 may displayalternative information, such as recommended music for the user based onthe music album corresponding to the icon 4304 (potentially based onother information about the user). In these instances, selection of asong or album icon from the lower portion 4306 may cause the device 100to navigate to a store from which the user may acquire the correspondingmusic or other music.

FIG. 44 illustrates an example UI 4400 showing music albums available tothe device. That is, this UI 4400 illustrates icons corresponding tomusic albums previously acquired by the user of the device. These albumsmay be stored locally on the device or remotely in the cloud. Selectionof an icon from the UI 4400 may cause the device 100 to begin playingthe corresponding music. In addition, the UI 4400 includes an icon 4402(a shopping cart) that, when selected, navigates the device to a musicstorefront where the user may acquire additional music.

In addition, FIG. 44 illustrates an example right panel 4404 showingadditional information regarding the music albums in response to a useperforming a peek gesture to the right. This additional information mayinclude a number of songs of each device, whether the device is storedlocally on the device (indicated by the check mark), a year that thealbum was released, a length of the album, and the like.

FIG. 45 illustrates an example UI 4500 showing music albums available tothe device, such as albums that the user of the device has previouslyacquired. In addition, this figure illustrates an example left panel4502 that the device 100 may display when the user performs a tiltgesture to the left from the center-panel UI 4500 corresponding to themusic application. As illustrated, the left panel 4502 comprises anavigation menu that allows the user to navigate his or her own music,as well as navigate within a music store for acquiring additional music.

FIG. 45 also illustrates an example right panel 4504 that the device 100may display in response to the user performing a tilt gesture to theright from the UI 4500. As illustrated, additional content may bedisplayed to the user based on the music of the user (e.g., the musicindicated in the UI 4500). For example, the right panel 4504 may includemusic that is recommended for the user based on information about theuser, music that has been newly released, and best sellers inmusic—generally, in a genre that the user often listens to, or basedupon the music that is displayed in the center-panel UI 4500.

FIG. 46 illustrates an example UI 4600 showing a particular music albumavailable to the device. As illustrated, the UI 4600 includes cover artfor the music currently being played back by the device, as well astracks on the album and a progress bar showing current progress throughthe track and a length of each track (which, in some instances, may beshown upon a peek gesture). In some instances, some or all of thisinformation (e.g., track length, progress bar, etc.) may be displayed inresponse to the user performing a peek gesture on the device.

In addition, FIG. 46 illustrates an example right panel 4602 that thedevice may display in response to the use performing a tilt gesture tothe right. As illustrated, the right panel 4602 may illustrate itemsthat an array of different recommended music based on the albumcurrently displayed in the UI 4600 and that is currently being played.For instance, this information may include other music by the artist,music that customers who have bought the currently playing album havealso purchased or otherwise acquired, and the like. Therefore, the useris able to view additional music that may be of interest to the user byperforming the tilt gesture to the right.

FIG. 47 illustrates an example UI 4700 showing a particular song that iscurrently playing on the device. In addition, the FIG. 47 illustrates anexample right panel 4702 that the device 100 may display in response tothe user performing a tilt gesture to the right. In this example, theright panel 4702 displays lyrics of the song, if available. The device100 may store these lyrics locally or may obtain the lyrics in responseto the user performing the tilt gesture. In addition, the right panel4702 highlights or otherwise indicates, within the lyrics, a currentportion of the song that the device is currently outputting.

FIG. 48 illustrates an example UI 4800 showing music items available foracquisition within a music storefront. As illustrated, the UI 4800includes certain music recommended for the user, music recommended by aneditor of the storefront, and the like. The UI 4800 also includes a linkor icon (“music library”) that, when selected, causes the device 100 todisplay music of the user.

In response to the user performing a tilt gesture to the left, thedevice 100 may display a left panel 4802 that includes a navigation menu4802 for navigating the music store as well as music of the user. Inaddition, in response to the user performing a tilt gesture to the rightfrom the center-panel UI 4800, the device 100 may display a right panel4804. As illustrated, the right panel 4804 may display newly releasedmusic and/or other classes of music offered for acquisition by the user.As such, a user is able to view newly released music from a musicstorefront by performing the tilt gesture to the right.

FIG. 49 illustrates an example UI 4900 that includes a carousel of icons4902 that is navigable by a user of the device, potentially viahorizontal swipe gestures on the display. The UI 4900 illustrates that,in this example, an icon 4904 corresponding to a gallery of photoscurrently has user-interface focus in the carousel 4902. As illustrated,the information beneath the carousel, in a lower portion 4906, maycomprise photos from the gallery. For instance, the lower portion 4906may include photos captured by a camera of the device 100, with photosmost recently captured appearing at the top. In addition, FIG. 49illustrates the UI 4900 after the user performs a peek gesture. Inresponse, the device 100 may display additional information regardingthe photos from the gallery in the lower portion 4906 of the UI 4900.This additional information may comprise when the respective photo wascaptured, people or things tagged in the photos, or the like.

FIG. 50 illustrates an example UI 5000 showing a particular photodisplayed on the device. For instance, in response to a user of thedevice 100 selecting a thumbnail icon associated with a particularphoto, the device 100 may display the photo within the UI 5000. Inaddition, FIG. 50 illustrates an example right panel 5002 that thedevice 100 may display in response to the user performing a tilt gestureto the right. As illustrated, the right panel 5002 may displayinformation (metadata) associated with the photo. This information mayinclude an indication of when the photo was captured, a name of thephoto, a size of the photo, when the photo was added to the device or toa particular album, dimensions of the photo, people or things tagged inthe photo, or the like.

FIG. 51 illustrates an example UI 5100 of a carousel of icons 5102 thatis navigable by a user of the device 100, with an icon 5104corresponding to a music album currently having user-interface focus inthe carousel. As illustrated, the music album includes a badgeindicating that this album is offered for acquisition in the musicstore. The UI 5100 may also include a search bar that allows the user tosearch the device and/or the music store for music from the UI 5100. Inaddition, the UI 5100 includes a lower portion 5106 that includesinformation comprising additional music offered for acquisition in themusic store. The user may select the carousel icon 5102 or any of theitems listed in the lower portion 5106 to navigate to correspondingportions of the music store.

In addition, this figure illustrates that the user may perform a peekgesture in order to cause the device to display additional informationregarding the items listed in the lower portion 5106 of the UI 5100. Forinstance, this additional information may comprise a rating of eachitem, a number of reviews that constitute the rating, a number of songson the album, a release year of the music, and/or any other type ofsimilar or different information.

FIG. 52 illustrates an example UI 5200 showing search results associatedwith items offered for acquisition in a store. In addition, this figureillustrates example details 5202 associated with the items, with thesedetails being displayed in response to a user performing a peek gesture.These example additional details 5202 may comprise a cumulative ratingof each of the item as provided by other users and/or any other type ofadditional information.

FIG. 53 illustrates an example UI 5300 showing a storefront of anoffering service, as presented by a shopping application. In thisexample, the user performs a tilt gesture to the right and, in response,the device 100 display an example right panel 5302. In this example,because the user is “logged in” and, therefore, the identity of the useris known, the right panel 5302 may display new content that has beenrecommended for the user. That is, the offering service may determine anarray of content that the user may be interested in based on knowninformation of the user (e.g., past purchase history) and may displaythis newly recommended content to the user in response to the userperforming the tilt gesture. In instances where the user is not loggedin or otherwise known to the device and the offering service, the rightpanel 5302 may comprise new content, best-selling content, and the like.

FIG. 54 illustrates an example UI 5400 showing search results associatedwith items offered for acquisition. The device 100 may display the UI5400 in response to a user of the device 100 conducting an examplesearch in the music store for content related to “rock”. The UI 5400includes the top music albums that match this search.

In addition, FIG. 54 illustrates an example right panel 5402 that thedevice 100 may display in response to a user of the device performing atilt gesture to the right from the search-results UI 5400. Asillustrated, the right panel 5402 may indicate best sellers in the musicstore. These best sellers may be across all music, best sellers from thecontent that matches the user's query (“rock”), or the like.

FIG. 55 illustrates an example UI 5500 showing a detail page thatillustrates information associated with a particular item offered foracquisition. This UI 5500 may include an image of the item, detailsregarding the item (e.g., price, rating, etc.), different optionsassociated with the item (e.g., different box sizes), an icon thatallows the user to purchase the item, an icon that allows the user toadd the item to a cart of the user, and the like.

In addition, FIG. 55 illustrates an example right panel 5502 that thedevice 100 may display in response to a user of the device performing atilt gesture to the right. This right panel 5502 may indicate otheritems that are often purchased with the item illustrated in the UI 5500,other recommended items for the user (e.g., as determined by thebrowsing history of the user), and the like.

FIG. 56 illustrates an example UI 5600(1) of a carousel of icons 5602that is navigable by a user of the device 100, with an icon 5604corresponding to an application store currently having user-interfacefocus in the carousel 5602. The UI 5600(1) may also include a search barthat allows the user to search the application store directly from theUI 5600(1). As illustrated, the UI 5600(1) may include a lower portion5606 that indicates, beneath the carousel 5602, applications that arerecommended to the user (e.g., based on applications that the user haspreviously acquired). While no description is illustrated here, in someinstances the application icons may include a name, price, and otherdetails regarding the applications.

FIG. 56 further illustrates the UI 5600(2) after the user has swipedupwards in the lower portion 5606 of the UI 5600(1). As illustrated, inresponse to this gesture, the UI 5600(2) displays additional informationregarding the applications recommended for the user. This additionalinformation includes a textual description of each application, a costof each application, a rating of each application, a category of eachapplication, and the like. The user may perform a swipe gesturedownwards within the lower portion 5606 in order to transition from theUI 5600(2) to the UI 5600(1).

Finally, FIG. 56 illustrates the UI 5600(3) after a user has performed apeek gesture from the UI 5600(2). Here, the UI 5600(3) has displayedeven more information regarding the recommended items, such as ratingsof the applications, a number of reviews that constitute each rating,and the like.

FIG. 57 illustrates an example UI 5700 showing search results within anapplication store that may be displayed in response to a user performinga search within the store. The UI 5700, for example, displays a rankedlist of applications that are related to the user's query, “games”. Inaddition, this figure illustrates an example right panel 5702 that thedevice may display in response to a user performing a tilt gesture tothe right. This right panel 5702 may indicate more items (applications)that the user may consider, based on applications within the applicationstore that the user has viewed. For instance, the right panel 5702 mayindicate, to the user, applications viewed by other users who alsoviewed applications that the subject user of the device 100 has viewed.

FIG. 58 illustrates an example UI 5800 showing details associated with aparticular application available for acquisition from an applicationstore. That is, the UI 5800 may comprise a “detail page” associated witha particular application in the application store. The details regardingthe particular application may include a name of the application, adescription of the application, a rating of the application, imageswithin the application, and the like.

In addition, this figure illustrates an example right panel 5802 thatthe device 100 may display in response to a user performing a tiltgesture to the right. As illustrated, this right panel 5802 illustratesapplications that other users who have viewed or acquired the subjectapplication have also acquired.

FIG. 59 illustrates an example sequence of Uls 5900 and operations foridentifying an item from an image captured by a camera of the device, aswell as adding the item to a list of the user (e.g., a wish list).

At 5902, the user of the device 100 launches a camera application suchthat the user is able to view, on the display 102, the visualinformation that the camera is currently capturing. The user may thenpoint the camera a physical object in the environment a press aparticular physical button, such as the button 116(2), to capture theimage and cause the device 100 to identify the physical object (in thiscase a particular book). As such, at 5904, and in response to the userpressing the button 116(2), the device 100 may query a database ofphysical objects to identify the object. As illustrated, the device 100may display information regarding this object, such as an image of theobject and a price of the object as offered by an offering service.

At 5906, the user may press and hold on the on the display 102 (e.g., onthe item itself) for a threshold amount of time. In response, the device100 may perform a particular action associated with the item. Forinstance, at 5908 the device 100 may add the item (here, the book) to awish list associated with the user. In other instances, the device 100may acquire the book for the user or may perform some other actionregarding the identified item.

Furthermore, in some instances the device may add this item to the wishlist (or may perform some other action regarding the item) in responseto the user performing a predefined gesture. For instance, a user maytouch the item on the display and may perform a swivel gesture in orderto add the item to the wish list of the user. In some instances, theuser may depress and hold the physical button and may perform the swivel(or other) gesture in order to add the item to the wish list.

FIG. 60 illustrates another example sequence of Uls 6000 and operationsfor adding an item to a wish list of the user using a physical button ofthe device and/or another gesture indicating which of the items the useris selecting. At 6002, the device 100 display search results of items inresponse to a user conducting a search within a store on the device 100.At 6004, the user touches and holds a particular item listed in thesearch results and selects a physical button of the device, such as thebutton 116(2). In response, and as illustrated at 6006, the device 100may add the item (here, the mixer) to a wish list associated with theuser. In other instances, the device 100 may acquire the mixer for theuser or may perform some other action regarding the identified item.

Furthermore, in some instances the device may add this item to the wishlist (or may perform some other action regarding the item) in responseto the user performing a predefined gesture. For instance, a user maytouch the item on the display and may perform a swivel gesture in orderto add the item to the wish list of the user. In some instances, theuser may depress and hold the physical button and may perform the swivel(or other) gesture in order to add the item to the wish list.

FIG. 61 illustrates another example sequence of UIs 6100 and operationsfor adding yet another item to a wish list of the user when the user iswithin a browser application of the device 100. At 6102, the user isviewing a particular web page on the device 100 in a browserapplication. As illustrated, the web page illustrates or otherwiseindicates a particular item. In some instances, at 6104 the userdepresses the physical button 116(2) of the device and/or depresses thebutton and performs a particular gesture (e.g., a swivel gesture). Inresponse, at 6106, the device 100 identifies the item within anelectronic catalog of an offering service and adds the item to a wishlist of the user.

In addition, in some instances the user may perform certain operationson the items listed in the wish list (or other list) from the UI shownat 6106. For instance, a user may remove an item from the wish list byperforming a swipe gesture to the left on an area of the display 102that displays the particular item. Additionally, a user may add the itemto a cart of automatically purchase or otherwise acquire the item byperforming a swipe gesture to the right on a portion of the displayillustrating the item.

FIG. 62 illustrates an array of example UIs that the device mayimplement in the context of an application that puts limits on whatcontent children may view from the device and limits on how the childrenmay consume the content. In addition, certain gestures and otherfeatures (e.g., 3D-modeled icons) may be disabled for certain childprofiles. A first UI 6200 includes a carousel of icons 6202 and an icon6204 corresponding to an application (“Kindle Freetime”) that may beused to limit the amount of nature of content consumed by children. Thatis, a parent or other user may configure accounts for children such thatthe parent is able to determine for how long the child is able tooperate the device 100 as well as what content the child is able to viewor use. As illustrated, because the icon 6204 has the user-interfacefocus, a lower portion 6206 of the UI 6200 illustrates particularaccounts that have been created for the application corresponding to theicon 6204. As illustrated, a user of the device 100 has created twodifferent accounts, one for a child named Jacob and another for a childnamed Emily.

A UI 6208 illustrates a menu associated with the “Freetime” application.This menu allows the user to toggle between different profiles oraccounts as well as manage the accounts. In some instances, a parent mayneed to “log in” in order to manage the children's accounts. Further, insome instances the UI 6208 may be displayed by a predefined gesture,such as a tilt gesture to the left.

A UI 6210, meanwhile, illustrates different categories of content that aparent may manage and that a Freetime-application user may consume. Theexample categories include books, music, applications, videos, andcharacters. A UI 6212 displays a screen that the device 100 may presentin response to a user selecting the category “books”. As shown, thebooks that the user (e.g., child) is able view comprise children'sbooks. Similarly, a UI 6214 displays a screen listing applicationsavailable to the child, with a parent potentially having indicated forthis particular account that these applications are allowable.

FIG. 63 illustrates additional UIs that the device may display as partof the application that limits the content and the consumption of thecontent for children using the device. A UI 6300 illustrates daily timelimits associated with each profile. For instance, “Emily” is limited toa screen time of one hour, while “Jacob” does not currently have anytime limitations. A UI 6302, meanwhile, comprises a screen from which aparent may manage time limits for an account. Here, the UI 6302comprises time limits for “Emily”. As shown, the UI 6302 allows theparent to turn on or off time limits. Here, the parent indicates thatEmily is able to have one hour of screen time, comprising thirty minutesof video, but Emily is able to read or use applications as much as shewould like. Finally, a UI 6304 indicates that Emily has used all of herallotted screen time. The UI 6304 also includes icons to “cancel” or“modify” these time limits.

FIG. 64A illustrates a UI 6400(1) comprising a carousel of icons 6402,as well as an icon corresponding to a map application 6404 currentlyhaving user-interface focus. In addition, a lower portion 6406 of the UIdisplays information corresponding to the map application. Here, thelower portion shows one recent search that the user has performed in themap application.

FIG. 64 further illustrates the UI 6400(2) after the user has swipedupwards in the lower portion 6406 of the UI 5600(1). As illustrated, inresponse to this gesture, the UI 6400(2) displays additional searchesrecently performed by the user in the map application. The user mayperform a swipe gesture downwards within the lower portion 6406 in orderto transition from the UI 6400(2) to the UI 6400(1).

Finally, FIG. 64 illustrates the UI 6400(3) after a user has performed apeek gesture from the UI 6400(2). Here, the UI 6400(3) has displayedeven more information regarding the recent searches, such as a locationor address of the recent searches, a date on which the user performedeach respective search, and the like.

FIG. 64B illustrates UI shown above in FIG. 64A. Here, the user selectsa recent search corresponding to the Empire State Building. In response,the device 100 displays a UI 6408 comprising a 3D-modeled object of theparticular building. In some instances the user may navigate orotherwise manipulate this 3D-modeled object by swipe gestures on thedisplay or by moving his or her head relative to the device (asdetermined by the corner cameras of the device 100).

FIG. 65 illustrates an example UI 6500 comprising a map that a mapapplication may display. In addition to the map, the UI 6500 may includea search bar to allow the user to conduct a new search within the mapapplication. In addition, FIG. 65 illustrates an example right panel6502 that the device may display in response to a user of the deviceperforming a tilt gesture to the right. As illustrated, the right panel6502 may include one or more bookmarks that the user has made using themap application. The right panel 6502 may also include instructions oran icon for creating a bookmark. In response to selecting a bookmarkfrom the right panel 6502, the map application may display a mapcorresponding to the selected bookmark on the device 100. Alternatively,the right panel may allow a user to “share” his or her location withothers, such as with a social network of the user.

FIG. 66 illustrates a UI 6600(1) comprising a carousel of icons 6602,with an icon 6604 corresponding to a weather application havinguser-interface focus. As illustrated, because the icon 6604 has theuser-interface focus, a lower portion 6606 of the UI 6600(1) may includeinformation from the weather application. Here, for example, the lowerportion 6606 includes a brief description of the weather for the currentday at a location associated with the user of the device 100.

In addition, FIG. 66 illustrates a UI 6600(2) after the user hasperformed an upwards swipe gesture in the lower portion 6606 of the UI.In response, the UI 6600(2) displays additional information from theweather application in the lower portion 6606 of the UI 6600(2). Here,for instance, the additional information comprises an extended forecastat the location of the user. Of course, while FIG. 66 displays anextended forecast in response to the user swiping upwards, in otherinstances the UI may display a detailed forecast for the day (e.g.,hourly), weather at other locations (e.g., as previously requested bythe user), or the like. Finally, FIG. 66 illustrates, via UI 6600(3),that the user may perform a peek gesture to view additional informationon the display 102. Here, for instance, the UI 6600(3) has added a dateassociated with each day in the extended forecast. In other instances,the peek gesture may add any other type of supplemental information,such as high and low temperatures in a different metric (e.g., Celsius),or the like.

FIG. 67 illustrates an example UI 6700 showing a current weather reportfor a particular geographical location, which may be displayed as partof a weather application executing on the device. As illustrated, a userof the device 100 may perform a tilt gesture to the right in order tocause the device to display an example right panel 6702. As illustrated,the UI 6700 may display a current weather, while the right panel 6702may comprise an extended forecast in this example.

FIG. 68 illustrates an example UI 6800(1) having a carousel of icons6802 that is navigable by the user with an icon 6804 corresponding to aclock widget currently having user-interface focus. In addition, the UI6800(1) includes a lower portion 6806, which is populated withinformation from the clock widget given the current user-interfacefocus. As illustrated, this information in the lower portion 6806comprises settings associated with one or more alarms previouslyconfigured by the user. The user may alter these settings (e.g., turn onor off, change the time, etc.) from the lower portion 6806 or inresponse to selecting a particular alarm from the list and thereafteraltering the settings.

In addition, FIG. 68 illustrates a UI 6800(2) after performing a peekgesture. Here, the UI 6800(2) displays additional information in thelower portion 6806. Here, the additional information comprises a name ofeach alarm, although other implementations may comprise any other typeof supplemental content.

FIG. 69 illustrates an example UI 6900(1) showing a current time,current weather, and a time of next alarm set on the device 100. This UI6900(1) may be displayed as part of a lock screen of the device 100, inresponse to a user launching the clock application, or the like. Asillustrated, a UI 6900(2) may be displayed in response to a userperforming a peek gesture. Here, the UI 6900(2) has added somesupplementary information to the UI 6900(1). For instance, the UI6900(2) includes text indicating the meaning of the icons on thedisplay, as well as an indication of a time zone associated with theuser's current location.

In addition, this figure illustrates a left panel 6902 that the device100 may display in response to a user performing a tilt gesture to theleft. This left panel 6902 may comprise a settings menu that allows auser to modify settings associated with the clock application, such as atime of alarms, a location for which to display weather, and the like.

FIG. 70 illustrates an example UI 7000(1) showing a current time and anext scheduled alarm, as part of a “nightstand clock” application. Inaddition, FIG. 70 illustrates a UI 7000(2) that the device 100 maydisplay in response to the user performing a peek gesture. Asillustrated, the UI 7000(2) may display text indicating the meaning ofthe icons on the UI 7000(1), potentially along with one or more piecesof supplemental information.

FIG. 71 illustrates another example UI 7100(1) that an alarm clockapplication may display. As illustrated, the UI 7100(1) displays anindication of each alarm set on the device, as well as whether eachalarm is currently on or off. The UI 7100(1) may also display acurrently time of day.

In addition, FIG. 71 illustrates a UI 7100(2) that the device 100 maydisplay in response to the user performing a peek gesture. Asillustrated, the UI 7100(2) may have added a textual description to theicons of the UI 7100(1), as well as a textual description or title ofeach of the alarms.

FIG. 72 illustrates an example UI 7200(1) showing a carousel of icons7202, with an icon 7204 corresponding to a document or word-processingapplication having user-interface focus. In addition, this figureillustrates a lower portion 7206 of the UI, with this lower portionincluding information populated by the application currently havinguser-interface focus. As such, the lower portion 7206 includes documentsrecently created and/or opened by the device, potentially sortedaccording to any sort of order.

This figure also illustrates an example UI 7200(2) that the device 100may display in response to the user of the device performing a peekgesture. As shown, the UI 7200(2) may include additional detailsregarding the items shown in the lower portion 7206 of the UI, such as asize of each corresponding document, whether the document is storedlocally on the device, or the like.

FIG. 73 illustrates an example UI 7300(1) showing a list of documentsavailable to the device. The device 100 may display this UI 7300(1) inresponse to the user launching a document or word-processingapplication. As illustrated, in this example the UI 7300(1) displaysgroups of folders and/or individual documents, and each folder and/ordocument is associated with a particular title and an icon indicating atype of format of the file. In addition, this figure illustrates anexample UI 7300(2) showing additional details regarding these documentsin response to a user performing a peek gesture. These additionaldetails may comprise a number of items in each folder, a number offolders in each folder, a size of particular document, or the like.

FIG. 74 illustrates an example UI 7400 that a document application maydisplay. As illustrated, the UI 7400 comprises a list of folders and/ordocuments available on the device, as well as icons that are selectableto create a new document and/or to edit an existing document. Inaddition, FIG. 74 illustrates an example left panel 7402 that the devicemay perform in response to the user performing a tilt gesture to theleft. As illustrated, the UI 7402 may comprise a settings menu thatallows a user to navigate his or her documents and/or manage settings ofthe document or word-processing application.

In addition, this figure illustrates an example right panel 7404 thatthe device 100 may display in response to a user performing a tiltgesture to the right. As illustrated, the UI 7404 may provide links thatare selectable to launch “favorite” documents of the user, recentlyopened documents of the user, or the like. In addition, the UI 7404 mayindicate an amount of local and cloud-based storage is remaining for theuser, as well as an icon to purchase additional storage.

FIG. 75 illustrates an example UI 7500(1) that includes a carousel oficons 7502 and an icon 7504 corresponding to a web-browsing applicationhaving user-interface focus in the carousel 7502. In addition, the UI7500(1) includes a lower portion 7506 that includes informationcorresponding to the application associated with the icon 7504 havingthe user-interface focus. As illustrated, the lower portion includes alink to view the “most visited” websites on the device and a link to aspecific offering service. In addition, the UI 7500(1) includes a searchbar to allow the user of the device to conduct a web search from the UI7500(1).

In addition, FIG. 75 illustrates an example UI 7500(2) after a userperforms an upwards swiping gesture in the lower portion 7506 of the UI.As illustrated, the UI 7500(2) now displays additional informationregarding the web-browsing application. For instance, in this examplethe lower portion 7506 now lists a title of the “most visited” websites,selection of which may cause the display to navigate to the siteassociated with the selected link. Finally, a UI 7500(3) illustratesadditional details that may be displayed in response to a user of thedevice 100 performing a peek gesture. Here, the lower portion 7506 ofthe UI now lists the actual web address of the most-visited websites.

FIG. 76A illustrates an example UI 7600 showing example search resultsin response to a user performing a web-based search. In addition, FIG.76 illustrates an example left panel 7602 that the device 100 maydisplay in response to the user performing a tilt gesture to the left.As illustrated, the left panel 7602 may display each open tab in theweb-browsing application, along with a control that allows a user toopen a new tab. Finally, this figure illustrates a right panel 7604 thatthe device may display in response to the user performing a tilt gestureto the right from the center-panel UI 7600. Here, the right panel 7604may include news and articles on the web that are currently trendingbased on trends of users on search engines, social-network posts, andthe like.

FIG. 76B illustrates an example UI 7606 of an example webpage displayedby the web-browsing application. In addition, FIG. 76B illustrates anexample left panel 7608 that the browsing application may display inresponse to the user performing a tilt gesture to the left. Asillustrated, the left panel 7608 may comprise a navigation menu thatallows the user to navigate to the webpages that the user has “mostvisited”, to webpages bookmarked by the user, to pages that the user hassaved, to webpages that currently “trending”, and the like.

In addition, FIG. 76B illustrates an example right panel 7610 that thebrowsing application may display in response to a user performing a tiltgesture to the right. As illustrated, the right panel may comprise amenu of prominent (e.g., often selected) links within the webpageassociated with the UI 7606, or other links from other webpages that thedevice 100 has determined are related to the webpage associated with theUI 7606. Here, for instance, the webpage is associated with Boston and,similarly, the right panel 7610 includes links to Boston weather, Bostonsports teams, and the like.

FIG. 77 illustrates an example UI 7700 showing a calculator applicationthat the device 102 may display in response to the user launching thecalculator application. In addition, this figure illustrates a leftpanel 7702 that the application may display in response to a userperforming a tilt gesture to the left and a right panel 7704 that theapplication may display in response to a user performing a tilt gestureto the right. In this example, the right panel 7704 comprises a “tipcalculator” for calculating a tip based on an amount of a bill, such asa restaurant bill. As illustrated, the tip calculator includes a fieldto enter a check amount, a tip percentage, and a number of people thatthe user would like to split the bill across. After entering thesefigures, the tip calculator may display an amount of the tip per personand a total amount to be paid by each person. While the right panel inthis figure illustrates a tip calculator, in other examples, the rightpanel may comprise another sort of calculator or calculator function.This figure also illustrates the left panel 7702, which comprisesprevious or recent calculations performed by the calculator. The leftpanel 7702 also includes an option to clear the history or copy one ormore of the previous calculations for insertion into the calculatorapplication or another application.

The processes discussed below are each illustrated as a collection ofblocks in a logical flow graph, which represent a sequence of operationsthat can be implemented in hardware, software, or a combination thereof.In the context of software, the blocks represent computer-executableinstructions stored on one or more computer-readable media that, whenexecuted by one or more processing units, perform the recitedoperations. Generally, computer-executable instructions includeroutines, programs, objects, components, data structures, and the likethat perform particular functions or implement particular abstract datatypes. The order in which the operations are described is not intendedto be construed as a limitation, and any number of the described blockscan be combined in any order and/or in parallel to implement theprocesses. A client device, a remote content-item service, or both mayimplement the described processes.

FIG. 78 illustrates a flowchart of an example process 7800 of presentingone or more graphical user interfaces (GUIs) comprising a first portionincluding an icon representing an application and a second portion thatincludes icons or information representing one or more content itemsassociated with the application. The figure also shows techniques forallowing users to interact with the GUIs using one or more inputs orgestures (e.g., peek or tilt gestures).

At 7802, the process 7800 presents, on a display of an electronicdevice, a GUI comprising a first portion (e.g., carousel) including anicon (or collection of icons) representing an application (or collectionof application) available to the electronic device. The icon may beselectable to open the application. Further, the GUI may comprise asecond portion that includes one or more icons representing one or morecontent items (e.g., emails, text messages, audio albums, songs, videos,weather forecasts, and/or calendar appointments) associated with theapplication. In some instances, all of this information may be displayedwithout opening the application.

At 7804, the process 7800 receives input from one or more opticalsensors (e.g., cameras disposed proximate to corners of the electronicdevice). At 7806, the process determines a change in position of theelectronic device (e.g., rotational motion of the electronic deviceabout an axis parallel to the display) relative to at least a portion ofa user based at least in part on the input received from the opticalsensor(s).

At 7808, the process 7800 modifies the GUI at least partly in responseto determining the change in position of the electronic device relativeto the portion of the user. At 7810, the process 7800 receives inputfrom one or more inertial sensors (e.g., gyroscopes or accelerometers)and, at 7812, presents a second GUI on the display of the electronicdevice in response to the input from the one or more inertial sensors.The second GUI may comprise at least one of icons associated withcontent-item libraries including content items accessible to theelectronic device; a grid of icons corresponding to applicationsaccessible to the electronic device; or current or upcomingappointments, weather information, recent call information, recent emailinformation, recent messaging information, order status information,and/or content availability information.

At 7814, the process 7800 receives user input, such as a swipe up ordown touch input via touch screen or touch sensor. In response, and at7816, the process 7800 alters, at least partly in response to the userinput, display of the second portion to present additional informationregarding at least one of the one or more content items without openingthe application.

FIG. 79 illustrates a flowchart of an example process 7900 of presentinga GUI including a collection of application icons in a carousel whichare usable to open respective applications. The GUI also includesinformation of one or more content items associated with an applicationthat is in interface focus (e.g., in the front of the carousel).

At 7902, the process 7900 presents a collection of application icons ina carousel, each application icon usable to open a respectiveapplication. At 7904, the process 7900 receives user input to move anapplication icon of the collection of application icons to a front ofthe carousel. At 7906, the process 7900 presents information of one ormore content items associated with an application corresponding to theapplication icon moved to the front of the carousel.

At 7908, the process 7900 receives user input to move anotherapplication icon of the collection of application icons to the front ofthe carousel. At 7910, the process 7900 presents information of one ormore content items associated with an application corresponding to theother application icon moved to the front of the carousel withoutopening the application. At 7912, the process 7900 receives userselection of the application icon at the front of the carousel and, at7914, opens the application associated with the icon at the front of thecarousel responsive to receiving the user selection.

At 7916, the process 7900 receives input from one or more opticalsensors (e.g., cameras disposed proximate to one or more corners of theelectronic device). At 7918, the process 7900 determines a change inposition of the electronic device (e.g., rotational motion of theelectronic device about an axis parallel to the display of theelectronic device) relative to at least a portion of a user based atleast in part on the input received from the one or more opticalsensors. At 7920, the process 7900 presents additional/alternative infoon display at least partly in response to determining the change inposition of the electronic device relative to the portion of the user.

At 7922, the process 7900 receives input from one or more inertialsensors. Finally, at 7924, the process 7900 presents a user interfacepanel on the display of the electronic device in response to the inputfrom the one or more inertial sensors. This user interface panel maycomprise at least one of: icons associated with content-item libraries,each content-item library including content items accessible to theelectronic device; a grid of icons corresponding to applicationsaccessible to the electronic device; or current or upcomingappointments, weather information, recent call information, recent emailinformation, recent messaging information, order status information,and/or content availability information.

FIG. 80 illustrates a flowchart of an example process 8000 of detectingand recognizing a gesture (e.g., a swivel gesture) and performing anoperation such as, for example, those shown in FIG. 23A-FIG. 26responsive to the gesture.

At 8002, the process 8000 detects a first rotation of an electronicdevice in a first rotational direction about an axis perpendicular to adisplay of the device (e.g., by measuring an angle of the first rotationusing an inertial sensor and determines that the angle of the firstrotation meets or exceeds a first threshold angle of rotation, such as10 degrees). At 8004, the process 8000 detects a second rotation of theelectronic device consecutive to the first rotation, the second rotationbeing in a second rotational direction about the axis perpendicular tothe display of the device and being opposite the first rotationaldirection (e.g., by measuring an angle of the second rotation using aninertial sensor and determining that the angle of the second rotationmeets or exceeds a second threshold angle of rotation, such 5 degrees,which is less than the first threshold angle of rotation).

At 8006, the process 8000 recognizes the first rotation and the secondrotation as a predefined gesture (e.g., responsive to detecting thesecond rotation within a predetermined time of the detecting of thefirst rotation). At 8008, the process 8000 performs an operationresponsive to recognizing the predefined gesture. This operation maycomprise at least one of: causing one or more user interface controls tobe presented on the display of the electronic device; causing a systemchrome of the electronic device to be presented on the display of theelectronic device; causing one or more application launch controls to bepresented on the display of the electronic device (e.g., along asubstantially arc-shaped path); accessing location information of theelectronic device and causing presentation of a current location of theelectronic device, a control usable to “like” the current location ofthe electronic device, a control usable to check-in at the currentlocation of the electronic device, a control usable to bookmark thecurrent location of the electronic device, a control usable to share thecurrent location of the electronic device, and/or one or more points ofinterest within a predetermined distance of the current location of theelectronic device; causing a map (e.g., of surroundings of a currentlocation of the electronic device, a frequent route traveled by theelectronic device, and/or a location of an appointment in a calendar ofthe electronic device) to be presented on the display of the electronicdevice; or presenting traffic information corresponding to one or moreroutes presented on the map.

FIG. 81 illustrates a flowchart of another example process 8100 ofrecognizing a gesture (e.g., a swivel gesture) and performing anoperation such as, for example, those shown in FIG. 23A-FIG. 26responsive to the gesture.

At 8102, the process 8100 receives a signal from the one or moreinertial sensors (e.g., gyroscopes or accelerometers) indicating atransition of the electronic device from a first rotational motion(e.g., exceeding a first threshold angle of rotation, such as about 10degrees) about an axis to a second rotational motion (e.g., exceeding asecond threshold rotational motion, such as about 5 degrees, which isless than the first threshold angle of rotation) about the axis. In someinstances, the second rotational motion is in a direction opposite ofthe first rotational motion, and the axis is perpendicular to thedisplay, parallel to a length of the display, or parallel to the widthof the display.

At 8104, the process 8100 recognizes a predefined gesture based at leastin part on receipt of the signal. At 8106, the process 8100 performs anoperation responsive to recognizing the predefined gesture. Thisoperation may comprise at least one of: causing one or more userinterface controls to be presented on the display of the electronicdevice; causing a system chrome of the electronic device to be presentedon the display of the electronic device; causing one or more applicationlaunch controls to be presented on the display of the electronic device(e.g., along a substantially arc-shaped path); accessing locationinformation of the electronic device and causing presentation of acurrent location of the electronic device, a control usable to “like”the current location of the electronic device, a control usable tocheck-in at the current location of the electronic device, a controlusable to bookmark the current location of the electronic device, acontrol usable to share the current location of the electronic device,and/or one or more points of interest within a predetermined distance ofthe current location of the electronic device; causing a map (e.g., ofsurroundings of a current location of the electronic device, a frequentroute traveled by the electronic device, and/or a location of anappointment in a calendar of the electronic device) to be presented onthe display of the electronic device; or presenting traffic informationcorresponding to one or more routes presented on the map.

FIG. 82 illustrates a flowchart of an example process 8200 of presentingGUIs responsive to a relative orientation of a handheld electronicdevice relative to at least a portion of a body of a user.

At 8202, the process 8200 presents a first graphical user interface ofan application (e.g., a shopping application, a content libraryapplication such as books or music, a reader application, a media playerapplication, a web browser application, an email application, amessaging application, a weather application, a calendar application, amagic window application, a free time application, etc.) on a display ofa handheld electronic device responsive to receiving a signal from theone or more sensors indicating that the handheld electronic device isoriented with a display axis substantially aligned with a portion of auser's body. At 8204, the process 8200 presents a second graphical userinterface of the application on the display responsive to receiving asignal from the one or more sensors indicative of a first tilt gesturein which the handheld electronic device is oriented with the displayaxis offset from the portion of the user's body by a first angle in afirst rotational direction.

At 8206, the process 8200 presents a third graphical user interface ofthe application on the display responsive to receiving a signal from theone or more sensors indicative of a second tilt gesture in which thehandheld electronic device is oriented with the display axis offset fromthe portion of the user's body by a second angle in a second rotationaldirection opposite the first rotational direction. Finally, at 8208, theprocess 8200 presents supplemental information on the displayconcurrently with the first, second, and/or third graphical userinterfaces responsive to receiving a signal from the one or more sensorsindicative of a peek gesture in which the handheld electronic device isoriented with the display axis offset from the portion of the user'sbody: in the first rotational direction by an angle less than the firstangle, or in the second rotational direction by an angle less than thesecond angle.

FIG. 83 illustrates a flowchart of an example process 8300 of presentingGUIs responsive to a change in orientation of a handheld electronicdevice relative to at least a portion of a body of a user.

At 8302, the process 8300 causes a first pane of a graphical userinterface of an application (e.g., a shopping application, a contentlibrary application such as books or music, a reader application, amedia player application, a web browser application, an emailapplication, a messaging application, a weather application, a calendarapplication, a magic window application, a free time application, etc.)to be presented on a display of an electronic device. At 8304, theprocess 8300 detects a tilt gesture (e.g., based at least in part onsignals from one or more optical sensors and one or more inertialsensors) including a change in orientation of the electronic devicerelative to a user (e.g., by detecting a first rotational motion of theelectronic device in a first rotational direction about an axis parallelto the display followed by a second rotational motion in a secondrotational direction opposite the first rotational direction).

At 8306, the process 8300 causes, responsive to detecting the tiltgesture, a second pane of the graphical user interface of theapplication to be presented on the display of the electronic device. At8308, the process 8300 detects a peek gesture (e.g., based on output ofone or more optical sensors, such as cameras) including a second changein orientation of the electronic device relative to the user, the secondchange in orientation being smaller in magnitude than the change inorientation of the tilt gesture. Finally, at 8310, the 8300 overlays,responsive to detecting the peek gesture, supplemental information onthe first pane of the graphical user interface.

The device 100, as well as any other device capable of implementing thetechniques described above, may comprise any type of electronic device,such as a mobile electronic device (e.g., an electronic book reader, atablet device, a laptop computer, a smart phone or other multifunctioncommunication device, a portable digital assistant, a wearable device,an automotive display, etc.). Alternatively, the device may be anon-mobile electronic device (e.g., a computer display, a television, anappliance, a cash register, etc.).

The devices may include one or more processors and memory, one or moredisplays for displaying content items, one or more I/O components forinteracting with a respective device, one or more network interfaces,and one or more power sources. The network interfaces may support bothwired and wireless connection to various networks, such as cellularnetworks, radio, WiFi networks, short range networks (e.g., Bluetooth®),infrared (IR), and so forth.

Depending on the configuration of the electronic device, the memory 8104(and other memory described throughout) is an example of computerstorage media and may include volatile and nonvolatile memory. Thus, thememory may include, but is not limited to, RAM, ROM, EEPROM, flashmemory, or other memory technology, or any other medium that can be usedto store computer-readable instructions, programs, applications, mediaitems, and/or data which can be accessed by the respective electronicdevice. In some examples, the computer-readable media is a tangiblenon-transitory computer-readable media.

The memory may be used to store any number of functional components thatare executable on the processor, as well as content items that arerendered by the electronic device. Thus, the memory may include anoperating system and data storage to store one or more content items,such as eBooks, audio books, songs, videos, still images, and the like.The memory of each respective electronic device may also store one ormore content rendering applications to render content items on thedevice. These content presentation applications may be implemented asvarious applications depending upon the content items. For instance, thecontent presentation application may be an electronic book readerapplication for rending textual electronic books, an audio player forplaying audio books or songs, a video player for playing video, and soforth.

The electronic device 100 may have additional features or functionality.For example, the device may also include additional data storage devices(removable and/or non-removable) such as, for example, magnetic disks,optical disks, or tape. The additional data storage media may includevolatile and nonvolatile, removable and non-removable media implementedin any method or technology for storage of information, such as computerreadable instructions, data structures, program modules, or other data.In addition, some or all of the functionality described as residingwithin the device 800 may reside remotely from the device in someimplementations.

Although the subject matter has been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the subject matter defined in the appended claims is notnecessarily limited to the specific features or acts described. Rather,the specific features and acts are disclosed as example forms ofimplementing the claims.

What is claimed is:
 1. A mobile electronic device comprising: one ormore processors; memory; a touch-sensitive display; a housing defining ashape of the mobile electronic device; a first camera disposed in afirst portion of the housing; a second camera disposed in a secondportion of the housing; and a user-interface module, stored in thememory and executable on the one or more processors to: present, on thetouch-sensitive display, a screen comprising: an upper portion thatincludes a first list including icons representing applicationsavailable to the mobile electronic device, the first list beingscrollable horizontally by touch gestures on the touch-sensitive displayto alter an icon of the icons that has focus in the first list; and alower portion that includes a first icon representing a first contentitem associated with an application corresponding to the icon that hasfocus in the first list; determine a position of at least a portion of auser relative to the mobile electronic device based at least in part ondata from the first camera and the second camera; present, at leastpartly in response to the position of the user relative to the mobileelectronic device, an altered version of at least one of: the icon thathas focus in the first list, or the first icon in the lower portion. 2.The mobile electronic device as recited in claim 1, further comprising agyroscope sensor, and wherein the user-interface module is furtherexecutable to: (i) present a left-panel screen on the touch-sensitivedisplay in response to a first input detected by the gyroscope sensor,and (ii) present a right-panel screen on the touch-sensitive display inresponse to a second input detected by the gyroscope sensor.
 3. Themobile electronic device as recited in claim 2, wherein: the left-panelscreen includes icons associated with content-item libraries, eachcontent-item library including content items accessible to the mobileelectronic device; and the right-panel screen includes a grid of iconscorresponding to applications accessible to the mobile electronicdevice.
 4. The mobile electronic device as recited in claim 1, whereinthe user-interface module is further executable to: receive a firsttouch gesture on the touch-sensitive display, the first touch gesturegenerally upwards from a bottom of the screen towards a top of thescreen; present, at least partly in response to the first touch gesture,additional information in the lower portion regarding the first contentitem represented by the first icon; receive a second touch gesture onthe touch-sensitive display, the second touch gesture generallydownwards from the top of the screen towards the bottom of the screen;and remove, at least partly in response to the second touch gesture, theadditional information regarding the first content item represented bythe first icon.
 5. One or more computer-readable media storingcomputer-executable instructions that, when executed on one or moreprocessors, cause the one or more processors to perform acts comprising:presenting, on a display of an electronic device, a first graphical userinterface comprising: a first portion including a first iconrepresenting a first application available to the electronic device, thefirst icon being selectable to open the first application; and a secondportion that includes a second icon representing one or more contentitems associated with the first application corresponding to the firsticon in the first portion; receiving data from one or more opticalsensors of the electronic device; determining a change in position ofthe electronic device relative to at least a portion of a user based atleast in part on the data; and presenting, at least partly in responseto the determining the change in position of the electronic devicerelative to the portion of the user, a second graphical user interfacedifferent than the first graphical user interface.
 6. The one or morecomputer-readable media of claim 5, wherein the one or more contentitems comprise one or more of emails, text messages, audio albums,songs, videos, weather forecasts, or calendar appointments.
 7. The oneor more computer-readable media of claim 5, wherein the first portioncomprises a carousel comprising the first icon representing the firstapplication and one or more other icons representing other applications.8. The one or more computer-readable media of claim 5, wherein thesecond icon representing the one or more content items presentsinformation of the one or more content items without opening the firstapplication.
 9. The one or more computer-readable media of claim 5,wherein the one or more optical sensors comprise a first camera disposedin a first portion of a housing of the electronic device and a secondcamera disposed in a second portion of the housing of the electronicdevice.
 10. The one or more computer-readable media of claim 5, whereinthe determining the change in position of the electronic device relativeto at least the portion of the user comprises determining a rotationalmotion of the electronic device about an axis parallel to the display ofthe electronic device.
 11. The one or more computer-readable media ofclaim 5, further comprising: receiving data from one or more inertialsensors; presenting a third graphical user interface on the display ofthe electronic device in response to the data from the one or moreinertial sensors.
 12. The one or more computer-readable media of claim11, wherein the third graphical user interface comprises an iconassociated with a content-item library, the content-item libraryincluding one or more content items accessible to the electronic device.13. The one or more computer-readable media of claim 11, wherein thethird graphical user interface comprises a grid of icons correspondingto applications accessible to the electronic device.
 14. The one or morecomputer-readable media of claim 11, wherein the third graphical userinterface comprises at least one of current or upcoming appointments,weather information, recent call information, recent email information,recent messaging information, order status information, or contentavailability information.
 15. The one or more computer-readable media ofclaim 5, further comprising: receiving user input; and presenting, atleast partly in response to the user input, additional information inthe second portion regarding at least one of the one or more contentitems represented by the second icon without opening the application.16. A method comprising: under control of an electronic deviceconfigured with specific instructions executable by one or moreprocessors of the electronic device, presenting, on a display of theelectronic device, application icons in a carousel, a first applicationicon usable to open a first application; receiving user input to movethe first application icon to a front of the carousel; presenting firstinformation of one or more content items associated with the firstapplication; receiving data from one or more optical sensors of theelectronic device; determining a change in position of the electronicdevice relative to at least a portion of a user based at least in parton the data; and presenting second information on the display at leastpartly in response to determining the change in position.
 17. The methodof claim 16, further comprising: receiving user selection of the firstapplication icon at the front of the carousel; and opening the firstapplication associated with the first application icon at the front ofthe carousel responsive to receiving the user selection.
 18. The methodof claim 16, further comprising: receiving user input to move a secondapplication icon of the application icons to the front of the carousel;and presenting third information of one or more content items associatedwith a second application corresponding to the second application iconmoved to the front of the carousel.
 19. The method of claim 16, whereinthe presenting the first information of the one or more content itemsassociated with the first application corresponding to the firstapplication icon moved to the front of the carousel is performed withoutopening the first application.
 20. The method of claim 16, wherein theone or more optical sensors comprise a first camera disposed in a firstportion of a housing of the electronic device and a second cameradisposed in a second portion of the housing of the electronic device.21. The method of claim 16, wherein the determining the change inposition of the electronic device relative to at least the portion ofthe user comprises determining a rotational motion of the electronicdevice about an axis parallel to the display of the electronic device.22. The method of claim 16, further comprising: receiving data from oneor more inertial sensors; presenting a user interface panel on thedisplay of the electronic device in response to the data from the one ormore inertial sensors.
 23. The method of claim 22, wherein the userinterface panel comprises icons associated with content-item libraries,each content-item library including content items accessible to theelectronic device.
 24. The method of claim 22, wherein the userinterface panel comprises a grid of icons corresponding to applicationsaccessible to the electronic device.
 25. The method of claim 22, whereinthe user interface panel comprises at least one of current or upcomingappointments, weather information, recent call information, recent emailinformation, recent messaging information, order status information, orcontent availability information.